You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@sd-datasolutions.de> on 2012/12/12 01:13:06 UTC

[JENKINS] Lucene-Solr-4.x-Linux (64bit/jdk1.7.0_09) - Build # 3172 - Still Failing!

Build: http://jenkins.sd-datasolutions.de/job/Lucene-Solr-4.x-Linux/3172/
Java: 64bit/jdk1.7.0_09 -XX:+UseParallelGC

2 tests failed.
FAILED:  org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch

Error Message:
There are still nodes recoverying - waited for 540 seconds

Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 540 seconds
	at __randomizedtesting.SeedInfo.seed([A672C1073219D55D:27944F1F4546B561]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:165)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:115)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:110)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:563)
	at org.apache.solr.cloud.BasicDistributedZk2Test.brindDownShardIndexSomeDocsAndRecover(BasicDistributedZk2Test.java:321)
	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:83)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:601)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)


FAILED:  org.apache.solr.cloud.BasicDistributedZkTest.testDistribSearch

Error Message:
Server at http://127.0.0.1:38136/solr returned non ok status:500, message:Server Error

Stack Trace:
org.apache.solr.common.SolrException: Server at http://127.0.0.1:38136/solr returned non ok status:500, message:Server Error
	at __randomizedtesting.SeedInfo.seed([A672C1073219D55D:27944F1F4546B561]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:372)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
	at org.apache.solr.client.solrj.request.CoreAdminRequest.process(CoreAdminRequest.java:429)
	at org.apache.solr.client.solrj.request.CoreAdminRequest.getStatus(CoreAdminRequest.java:472)
	at org.apache.solr.cloud.BasicDistributedZkTest.collectStartTimes(BasicDistributedZkTest.java:959)
	at org.apache.solr.cloud.BasicDistributedZkTest.testCollectionsAPI(BasicDistributedZkTest.java:795)
	at org.apache.solr.cloud.BasicDistributedZkTest.doTest(BasicDistributedZkTest.java:343)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:601)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)




Build Log:
[...truncated 8533 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZkTest
[junit4:junit4]   2> 9 T19 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZkTest-1355270173136
[junit4:junit4]   2> 12 T19 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 14 T20 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 35 T20 oaz.Environment.logEnv Server environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
[junit4:junit4]   2> 36 T20 oaz.Environment.logEnv Server environment:host.name=serv1
[junit4:junit4]   2> 36 T20 oaz.Environment.logEnv Server environment:java.version=1.7.0_09
[junit4:junit4]   2> 36 T20 oaz.Environment.logEnv Server environment:java.vendor=Oracle Corporation
[junit4:junit4]   2> 37 T20 oaz.Environment.logEnv Server environment:java.home=/mnt/ssd/jenkins/tools/java/64bit/jdk1.7.0_09/jre
[junit4:junit4]   2> 37 T20 oaz.Environment.logEnv Server environment:java.class.path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/test:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/codecs/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-solrj/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/common/lucene-analyzers-common-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/highlighter/lucene-highlighter-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/memory/lucene-memory-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/misc/lucene-misc-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/spatial/lucene-spatial-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/suggest/lucene-suggest-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/grouping/lucene-grouping-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queries/lucene-queries-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queryparser/lucene-queryparser-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/cglib-nodep-2.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-cli-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-codec-1.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-fileupload-1.2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-lang-2.6.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/easymock-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/guava-13.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/javax.servlet-api-3.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/metrics-core-2.1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/objenesis-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/spatial4j-0.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/commons-io-2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpclient-4.1.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpcore-4.1.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpmime-4.1.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/jcl-over-slf4j-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/log4j-over-slf4j-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-api-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-jdk14-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/wstx-asl-3.2.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/zookeeper-3.4.5.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-continuation-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-deploy-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-http-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-io-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-jmx-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-security-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-server-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-servlet-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-util-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-webapp-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-xml-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/servlet-api-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/hsqldb-1.8.0.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/junit-4.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/randomizedtesting-runner-2.0.5.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-launcher.jar:/var/lib/jenkins/.ant/lib/ivy-2.2.0.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jdepend.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-netrexx.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-antlr.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-commons-net.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-javamail.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-regexp.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jsch.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-xalan2.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-junit4.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jmf.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-junit.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-bcel.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jai.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-commons-logging.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-resolver.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-oro.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-swing.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-bsf.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-log4j.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-testutil.jar:/mnt/ssd/jenkins/tools/java/64bit/jdk1.7.0_09/lib/tools.jar:/var/lib/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.0.5.jar
[junit4:junit4]   2> 38 T20 oaz.Environment.logEnv Server environment:java.library.path=/mnt/ssd/jenkins/tools/java/64bit/jdk1.7.0_09/jre/lib/amd64/server:/mnt/ssd/jenkins/tools/java/64bit/jdk1.7.0_09/jre/lib/amd64:/mnt/ssd/jenkins/tools/java/64bit/jdk1.7.0_09/jre/../lib/amd64:/usr/lib/jvm/j2sdk1.6-sun/jre/lib/amd64/server:/usr/lib/jvm/j2sdk1.6-sun/jre/lib/amd64:/usr/lib/jvm/j2sdk1.6-sun/jre/../lib/amd64:/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
[junit4:junit4]   2> 38 T20 oaz.Environment.logEnv Server environment:java.io.tmpdir=.
[junit4:junit4]   2> 39 T20 oaz.Environment.logEnv Server environment:java.compiler=<NA>
[junit4:junit4]   2> 39 T20 oaz.Environment.logEnv Server environment:os.name=Linux
[junit4:junit4]   2> 39 T20 oaz.Environment.logEnv Server environment:os.arch=amd64
[junit4:junit4]   2> 39 T20 oaz.Environment.logEnv Server environment:os.version=3.2.0-34-generic
[junit4:junit4]   2> 40 T20 oaz.Environment.logEnv Server environment:user.name=jenkins
[junit4:junit4]   2> 40 T20 oaz.Environment.logEnv Server environment:user.home=/var/lib/jenkins
[junit4:junit4]   2> 40 T20 oaz.Environment.logEnv Server environment:user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 51 T20 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 52 T20 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4]   2> 52 T20 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4]   2> 62 T20 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 84 T20 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4]   2> 114 T19 oasc.ZkTestServer.run start zk server on port:40680
[junit4:junit4]   2> 136 T19 oaz.Environment.logEnv Client environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
[junit4:junit4]   2> 137 T19 oaz.Environment.logEnv Client environment:host.name=serv1
[junit4:junit4]   2> 138 T19 oaz.Environment.logEnv Client environment:java.version=1.7.0_09
[junit4:junit4]   2> 138 T19 oaz.Environment.logEnv Client environment:java.vendor=Oracle Corporation
[junit4:junit4]   2> 139 T19 oaz.Environment.logEnv Client environment:java.home=/mnt/ssd/jenkins/tools/java/64bit/jdk1.7.0_09/jre
[junit4:junit4]   2> 140 T19 oaz.Environment.logEnv Client environment:java.class.path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/test:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/codecs/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-solrj/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/common/lucene-analyzers-common-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/highlighter/lucene-highlighter-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/memory/lucene-memory-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/misc/lucene-misc-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/spatial/lucene-spatial-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/suggest/lucene-suggest-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/grouping/lucene-grouping-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queries/lucene-queries-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queryparser/lucene-queryparser-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/cglib-nodep-2.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-cli-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-codec-1.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-fileupload-1.2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-lang-2.6.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/easymock-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/guava-13.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/javax.servlet-api-3.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/metrics-core-2.1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/objenesis-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/spatial4j-0.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/commons-io-2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpclient-4.1.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpcore-4.1.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpmime-4.1.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/jcl-over-slf4j-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/log4j-over-slf4j-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-api-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-jdk14-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/wstx-asl-3.2.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/zookeeper-3.4.5.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-continuation-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-deploy-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-http-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-io-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-jmx-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-security-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-server-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-servlet-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-util-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-webapp-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-xml-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/servlet-api-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/hsqldb-1.8.0.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/junit-4.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/randomizedtesting-runner-2.0.5.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-launcher.jar:/var/lib/jenkins/.ant/lib/ivy-2.2.0.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jdepend.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-netrexx.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-antlr.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-commons-net.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-javamail.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-regexp.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jsch.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-xalan2.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-junit4.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jmf.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-junit.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-bcel.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jai.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-commons-logging.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-resolver.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-oro.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-swing.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-bsf.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-log4j.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-testutil.jar:/mnt/ssd/jenkins/tools/java/64bit/jdk1.7.0_09/lib/tools.jar:/var/lib/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.0.5.jar
[junit4:junit4]   2> 141 T19 oaz.Environment.logEnv Client environment:java.library.path=/mnt/ssd/jenkins/tools/java/64bit/jdk1.7.0_09/jre/lib/amd64/server:/mnt/ssd/jenkins/tools/java/64bit/jdk1.7.0_09/jre/lib/amd64:/mnt/ssd/jenkins/tools/java/64bit/jdk1.7.0_09/jre/../lib/amd64:/usr/lib/jvm/j2sdk1.6-sun/jre/lib/amd64/server:/usr/lib/jvm/j2sdk1.6-sun/jre/lib/amd64:/usr/lib/jvm/j2sdk1.6-sun/jre/../lib/amd64:/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
[junit4:junit4]   2> 142 T19 oaz.Environment.logEnv Client environment:java.io.tmpdir=.
[junit4:junit4]   2> 143 T19 oaz.Environment.logEnv Client environment:java.compiler=<NA>
[junit4:junit4]   2> 143 T19 oaz.Environment.logEnv Client environment:os.name=Linux
[junit4:junit4]   2> 144 T19 oaz.Environment.logEnv Client environment:os.arch=amd64
[junit4:junit4]   2> 145 T19 oaz.Environment.logEnv Client environment:os.version=3.2.0-34-generic
[junit4:junit4]   2> 145 T19 oaz.Environment.logEnv Client environment:user.name=jenkins
[junit4:junit4]   2> 146 T19 oaz.Environment.logEnv Client environment:user.home=/var/lib/jenkins
[junit4:junit4]   2> 147 T19 oaz.Environment.logEnv Client environment:user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 149 T19 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:40680 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@5df2d944
[junit4:junit4]   2> 180 T19 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 185 T25 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:40680. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 188 T25 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:40680, initiating session
[junit4:junit4]   2> 209 T21 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:35876
[junit4:junit4]   2> 220 T21 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:35876
[junit4:junit4]   2> 225 T23 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 440 T23 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8c65b2230000 with negotiated timeout 10000 for client /127.0.0.1:35876
[junit4:junit4]   2> 440 T25 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:40680, sessionid = 0x13b8c65b2230000, negotiated timeout = 10000
[junit4:junit4]   2> 443 T26 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5df2d944 name:ZooKeeperConnection Watcher:127.0.0.1:40680 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 443 T19 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 446 T19 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 472 T24 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8c65b2230000
[junit4:junit4]   2> 474 T21 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:35876 which had sessionid 0x13b8c65b2230000
[junit4:junit4]   2> 475 T26 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 475 T19 oaz.ZooKeeper.close Session: 0x13b8c65b2230000 closed
[junit4:junit4]   2> 476 T19 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:40680/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1f58cce5
[junit4:junit4]   2> 477 T19 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 478 T27 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:40680. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 479 T27 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:40680, initiating session
[junit4:junit4]   2> 479 T21 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:35877
[junit4:junit4]   2> 480 T21 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:35877
[junit4:junit4]   2> 481 T23 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8c65b2230001 with negotiated timeout 10000 for client /127.0.0.1:35877
[junit4:junit4]   2> 481 T27 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:40680, sessionid = 0x13b8c65b2230001, negotiated timeout = 10000
[junit4:junit4]   2> 482 T28 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f58cce5 name:ZooKeeperConnection Watcher:127.0.0.1:40680/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 482 T19 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 491 T19 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 497 T19 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 503 T19 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 511 T19 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 516 T19 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 530 T19 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 547 T19 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 548 T19 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 554 T19 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 554 T19 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 563 T19 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 564 T19 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 569 T19 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 570 T19 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 574 T19 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 574 T19 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 578 T19 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 579 T19 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 583 T19 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 584 T19 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 590 T19 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 591 T19 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 596 T19 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 597 T19 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 601 T24 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8c65b2230001
[junit4:junit4]   2> 602 T28 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 603 T21 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:35877 which had sessionid 0x13b8c65b2230001
[junit4:junit4]   2> 603 T19 oaz.ZooKeeper.close Session: 0x13b8c65b2230001 closed
[junit4:junit4]   2> 782 T19 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 867 T19 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:40765
[junit4:junit4]   2> 884 T19 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 885 T19 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355270173730
[junit4:junit4]   2> 885 T19 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355270173730/'
[junit4:junit4]   2> 901 T19 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 902 T19 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 902 T19 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355270173730
[junit4:junit4]   2> 903 T19 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355270173730/solr.xml
[junit4:junit4]   2> 903 T19 oasc.CoreContainer.<init> New CoreContainer 1460297432
[junit4:junit4]   2> 904 T19 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355270173730/'
[junit4:junit4]   2> 904 T19 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355270173730/'
[junit4:junit4]   2> 929 T19 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 940 T19 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:40680/solr
[junit4:junit4]   2> 948 T19 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 948 T19 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:40680 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@7d6d9366
[junit4:junit4]   2> 949 T19 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 951 T39 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:40680. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 951 T39 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:40680, initiating session
[junit4:junit4]   2> 952 T21 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:35878
[junit4:junit4]   2> 952 T21 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:35878
[junit4:junit4]   2> 953 T23 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8c65b2230002 with negotiated timeout 20000 for client /127.0.0.1:35878
[junit4:junit4]   2> 953 T39 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:40680, sessionid = 0x13b8c65b2230002, negotiated timeout = 20000
[junit4:junit4]   2> 954 T40 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7d6d9366 name:ZooKeeperConnection Watcher:127.0.0.1:40680 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 954 T19 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 956 T24 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8c65b2230002
[junit4:junit4]   2> 957 T21 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:35878 which had sessionid 0x13b8c65b2230002
[junit4:junit4]   2> 958 T40 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 957 T19 oaz.ZooKeeper.close Session: 0x13b8c65b2230002 closed
[junit4:junit4]   2> 960 T19 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:40680/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@4a1c2a40
[junit4:junit4]   2> 961 T19 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 962 T41 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:40680. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 962 T41 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:40680, initiating session
[junit4:junit4]   2> 963 T21 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:35879
[junit4:junit4]   2> 963 T21 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:35879
[junit4:junit4]   2> 964 T23 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8c65b2230003 with negotiated timeout 8000 for client /127.0.0.1:35879
[junit4:junit4]   2> 964 T41 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:40680, sessionid = 0x13b8c65b2230003, negotiated timeout = 8000
[junit4:junit4]   2> 965 T42 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4a1c2a40 name:ZooKeeperConnection Watcher:127.0.0.1:40680/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 965 T19 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 973 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b2230003 type:create cxid:0x2 zxid:0x1b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 979 T19 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 982 T19 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40765_solr
[junit4:junit4]   2> 985 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b2230003 type:delete cxid:0x7 zxid:0x1d txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:40765_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:40765_solr
[junit4:junit4]   2> 986 T19 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:40765_solr
[junit4:junit4]   2> 990 T19 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 990 T19 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 991 T19 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 991 T19 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 992 T19 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 993 T19 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 993 T19 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 994 T19 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 994 T19 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 995 T19 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 1001 T19 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 1012 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b2230003 type:delete cxid:0x15 zxid:0x22 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 1013 T19 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 1017 T19 oasc.Overseer.start Overseer (id=88818986072080387-127.0.0.1:40765_solr-n_0000000000) starting
[junit4:junit4]   2> 1018 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b2230003 type:create cxid:0x1a zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1023 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b2230003 type:create cxid:0x1b zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1024 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b2230003 type:create cxid:0x1c zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1028 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b2230003 type:create cxid:0x1d zxid:0x27 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1029 T44 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
[junit4:junit4]   2> 1030 T19 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 1033 T19 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 1043 T43 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 1068 T45 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355270173730/collection1
[junit4:junit4]   2> 1068 T45 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4]   2> 1069 T45 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 1070 T45 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4]   2> 1072 T45 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355270173730/collection1/'
[junit4:junit4]   2> 1073 T45 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355270173730/collection1/lib/README' to classloader
[junit4:junit4]   2> 1073 T45 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355270173730/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 1145 T45 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 1197 T45 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 1198 T45 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 1238 T45 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 1634 T45 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 1644 T45 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 1647 T45 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 1684 T45 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1695 T45 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1704 T45 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1711 T45 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1718 T45 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355270173730/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/control/data/
[junit4:junit4]   2> 1723 T45 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bb8a8c6
[junit4:junit4]   2> 1742 T45 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/control/data/index/
[junit4:junit4]   2> 1743 T45 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 1750 T45 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/control/data/index forceNew:false
[junit4:junit4]   2> 1758 T45 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1d85813a; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 1759 T45 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 1766 T45 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 1785 T45 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 1785 T45 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 1786 T45 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 1788 T45 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 1808 T45 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 1809 T45 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 1810 T45 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 1814 T45 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 1819 T45 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 1831 T45 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 1834 T45 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 1835 T45 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 1837 T45 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 1837 T45 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 1838 T45 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 1842 T45 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 1844 T45 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1846 T45 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1847 T45 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1849 T45 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1851 T45 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1853 T45 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1855 T45 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1860 T45 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 1866 T45 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 1869 T45 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 1870 T45 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 1874 T45 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 1877 T45 oass.SolrIndexSearcher.<init> Opening Searcher@cd89c9a main
[junit4:junit4]   2> 1878 T45 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 1886 T45 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 1886 T45 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 1887 T45 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 1900 T45 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 1959 T46 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@cd89c9a main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 1983 T45 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 1983 T45 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 1984 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b2230003 type:create cxid:0x53 zxid:0x2a txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 1989 T45 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 1989 T45 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:40765/solr shardId:control_shard
[junit4:junit4]   2> 1992 T45 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4]   2> 1999 T45 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/control_shard/election
[junit4:junit4]   2> 2008 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b2230003 type:delete cxid:0x62 zxid:0x31 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4]   2> 2009 T45 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 2010 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b2230003 type:create cxid:0x63 zxid:0x32 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2054 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2056 T43 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":"control_shard",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:40765_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:40765/solr"}
[junit4:junit4]   2> 2063 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b2230003 type:create cxid:0x6a zxid:0x34 txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 2090 T42 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 2513 T45 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 2514 T45 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 2515 T45 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:40765/solr/collection1/
[junit4:junit4]   2> 2516 T45 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 2516 T45 oasc.SyncStrategy.syncToMe http://127.0.0.1:40765/solr/collection1/ has no replicas
[junit4:junit4]   2> 2517 T45 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:40765/solr/collection1/
[junit4:junit4]   2> 2518 T45 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/control_shard
[junit4:junit4]   2> 2530 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b2230003 type:create cxid:0x89 zxid:0x3f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2607 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2620 T42 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 2635 T45 oasc.ZkController.register We are http://127.0.0.1:40765/solr/collection1/ and leader is http://127.0.0.1:40765/solr/collection1/
[junit4:junit4]   2> 2637 T45 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:40765/solr
[junit4:junit4]   2> 2638 T45 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 2639 T45 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 2639 T45 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 2643 T45 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2646 T19 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 2647 T19 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 2671 T19 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 2752 T19 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 2755 T19 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:45218
[junit4:junit4]   2> 2756 T19 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 2756 T19 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355270175808
[junit4:junit4]   2> 2757 T19 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355270175808/'
[junit4:junit4]   2> 2774 T19 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 2775 T19 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 2775 T19 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355270175808
[junit4:junit4]   2> 2775 T19 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355270175808/solr.xml
[junit4:junit4]   2> 2776 T19 oasc.CoreContainer.<init> New CoreContainer 1217203756
[junit4:junit4]   2> 2776 T19 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355270175808/'
[junit4:junit4]   2> 2777 T19 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355270175808/'
[junit4:junit4]   2> 2790 T19 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 2799 T19 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:40680/solr
[junit4:junit4]   2> 2799 T19 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 2800 T19 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:40680 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@70d488dc
[junit4:junit4]   2> 2801 T19 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2801 T56 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:40680. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 2802 T56 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:40680, initiating session
[junit4:junit4]   2> 2802 T21 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:35881
[junit4:junit4]   2> 2803 T21 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:35881
[junit4:junit4]   2> 2804 T23 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8c65b2230004 with negotiated timeout 20000 for client /127.0.0.1:35881
[junit4:junit4]   2> 2804 T56 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:40680, sessionid = 0x13b8c65b2230004, negotiated timeout = 20000
[junit4:junit4]   2> 2805 T57 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@70d488dc name:ZooKeeperConnection Watcher:127.0.0.1:40680 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2806 T19 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2808 T24 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8c65b2230004
[junit4:junit4]   2> 2810 T57 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 2810 T19 oaz.ZooKeeper.close Session: 0x13b8c65b2230004 closed
[junit4:junit4]   2> 2810 T21 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:35881 which had sessionid 0x13b8c65b2230004
[junit4:junit4]   2> 2811 T19 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:40680/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@53885c6b
[junit4:junit4]   2> 2812 T19 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2812 T58 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:40680. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 2813 T58 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:40680, initiating session
[junit4:junit4]   2> 2814 T21 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:35882
[junit4:junit4]   2> 2815 T21 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:35882
[junit4:junit4]   2> 2816 T23 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8c65b2230005 with negotiated timeout 8000 for client /127.0.0.1:35882
[junit4:junit4]   2> 2816 T58 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:40680, sessionid = 0x13b8c65b2230005, negotiated timeout = 8000
[junit4:junit4]   2> 2817 T59 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@53885c6b name:ZooKeeperConnection Watcher:127.0.0.1:40680/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2818 T19 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2819 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b2230005 type:create cxid:0x1 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2821 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b2230005 type:create cxid:0x2 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2824 T19 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45218_solr
[junit4:junit4]   2> 2825 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b2230005 type:delete cxid:0x4 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:45218_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:45218_solr
[junit4:junit4]   2> 2827 T19 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:45218_solr
[junit4:junit4]   2> 2831 T42 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 2834 T19 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 2835 T19 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 2837 T19 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 2837 T42 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 2837 T19 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 2838 T19 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 2839 T19 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 2840 T19 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 2841 T19 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 2842 T19 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 2843 T19 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 2862 T19 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 2877 T60 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355270175808/collection1
[junit4:junit4]   2> 2878 T60 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 2879 T60 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 2880 T60 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 2883 T60 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355270175808/collection1/'
[junit4:junit4]   2> 2885 T60 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty1-1355270175808/collection1/lib/README' to classloader
[junit4:junit4]   2> 2885 T60 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty1-1355270175808/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 2960 T60 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 3003 T60 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 3004 T60 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 3036 T60 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 3129 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3131 T43 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":"control_shard",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:40765_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:40765/solr"}
[junit4:junit4]   2> 3137 T59 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3137 T42 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3390 T60 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 3400 T60 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 3402 T60 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 3428 T60 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 3433 T60 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 3437 T60 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 3440 T60 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 3444 T60 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355270175808/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty1/
[junit4:junit4]   2> 3444 T60 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bb8a8c6
[junit4:junit4]   2> 3445 T60 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty1/index/
[junit4:junit4]   2> 3445 T60 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 3446 T60 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty1/index forceNew:false
[junit4:junit4]   2> 3450 T60 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@28f1d4e2; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 3450 T60 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 3451 T60 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 3453 T60 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 3454 T60 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 3454 T60 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 3454 T60 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 3455 T60 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 3455 T60 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 3456 T60 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 3458 T60 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 3460 T60 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 3462 T60 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 3464 T60 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 3465 T60 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 3467 T60 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 3467 T60 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 3468 T60 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 3470 T60 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 3472 T60 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3474 T60 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3476 T60 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3479 T60 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3481 T60 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3483 T60 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3485 T60 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3487 T60 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 3489 T60 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 3492 T60 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 3493 T60 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 3497 T60 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 3499 T60 oass.SolrIndexSearcher.<init> Opening Searcher@4482d3a3 main
[junit4:junit4]   2> 3500 T60 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 3501 T60 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 3501 T60 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 3502 T60 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 3507 T60 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 3549 T61 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4482d3a3 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 3566 T60 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 3567 T60 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 3645 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3646 T43 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:45218_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:45218/solr"}
[junit4:junit4]   2> 3647 T43 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4]   2> 3649 T43 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 3654 T42 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3654 T59 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 4070 T60 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 4071 T60 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:45218/solr shardId:shard1
[junit4:junit4]   2> 4073 T60 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 4091 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b2230005 type:delete cxid:0x45 zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 4093 T60 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 4094 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b2230005 type:create cxid:0x46 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4099 T60 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 4099 T60 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 4100 T60 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:45218/solr/collection1/
[junit4:junit4]   2> 4100 T60 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 4101 T60 oasc.SyncStrategy.syncToMe http://127.0.0.1:45218/solr/collection1/ has no replicas
[junit4:junit4]   2> 4101 T60 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:45218/solr/collection1/
[junit4:junit4]   2> 4102 T60 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 4114 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b2230005 type:create cxid:0x50 zxid:0x60 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4163 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4184 T42 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 4184 T59 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 4219 T60 oasc.ZkController.register We are http://127.0.0.1:45218/solr/collection1/ and leader is http://127.0.0.1:45218/solr/collection1/
[junit4:junit4]   2> 4219 T60 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:45218/solr
[junit4:junit4]   2> 4220 T60 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 4220 T60 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 4221 T60 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 4225 T60 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4228 T19 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 4228 T19 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 4229 T19 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 4286 T19 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 4290 T19 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:38136
[junit4:junit4]   2> 4290 T19 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 4291 T19 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355270177363
[junit4:junit4]   2> 4291 T19 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355270177363/'
[junit4:junit4]   2> 4304 T19 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 4304 T19 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 4305 T19 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355270177363
[junit4:junit4]   2> 4305 T19 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355270177363/solr.xml
[junit4:junit4]   2> 4305 T19 oasc.CoreContainer.<init> New CoreContainer 1474479830
[junit4:junit4]   2> 4306 T19 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355270177363/'
[junit4:junit4]   2> 4306 T19 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355270177363/'
[junit4:junit4]   2> 4320 T19 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 4329 T19 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:40680/solr
[junit4:junit4]   2> 4329 T19 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 4329 T19 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:40680 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@288ba95
[junit4:junit4]   2> 4330 T19 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4331 T71 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:40680. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 4332 T71 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:40680, initiating session
[junit4:junit4]   2> 4332 T21 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:35883
[junit4:junit4]   2> 4333 T21 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:35883
[junit4:junit4]   2> 4335 T23 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8c65b2230006 with negotiated timeout 20000 for client /127.0.0.1:35883
[junit4:junit4]   2> 4335 T71 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:40680, sessionid = 0x13b8c65b2230006, negotiated timeout = 20000
[junit4:junit4]   2> 4336 T72 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@288ba95 name:ZooKeeperConnection Watcher:127.0.0.1:40680 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4337 T19 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4340 T24 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8c65b2230006
[junit4:junit4]   2> 4341 T21 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:35883 which had sessionid 0x13b8c65b2230006
[junit4:junit4]   2> 4341 T72 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 4341 T19 oaz.ZooKeeper.close Session: 0x13b8c65b2230006 closed
[junit4:junit4]   2> 4342 T19 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:40680/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@2e9dd554
[junit4:junit4]   2> 4344 T19 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4344 T73 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:40680. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 4345 T73 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:40680, initiating session
[junit4:junit4]   2> 4345 T21 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:35885
[junit4:junit4]   2> 4346 T21 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:35885
[junit4:junit4]   2> 4348 T23 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8c65b2230007 with negotiated timeout 8000 for client /127.0.0.1:35885
[junit4:junit4]   2> 4348 T73 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:40680, sessionid = 0x13b8c65b2230007, negotiated timeout = 8000
[junit4:junit4]   2> 4349 T74 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2e9dd554 name:ZooKeeperConnection Watcher:127.0.0.1:40680/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4350 T19 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4352 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b2230007 type:create cxid:0x1 zxid:0x6d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4354 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b2230007 type:create cxid:0x2 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4357 T19 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38136_solr
[junit4:junit4]   2> 4359 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b2230007 type:delete cxid:0x4 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:38136_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:38136_solr
[junit4:junit4]   2> 4360 T19 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:38136_solr
[junit4:junit4]   2> 4365 T59 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 4365 T42 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 4367 T19 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 4368 T19 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 4369 T19 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 4370 T59 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 4370 T42 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 4370 T19 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 4371 T19 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 4372 T19 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 4373 T19 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 4373 T19 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 4374 T19 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 4375 T19 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 4389 T19 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 4403 T75 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355270177363/collection1
[junit4:junit4]   2> 4403 T75 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 4405 T75 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 4406 T75 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 4409 T75 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355270177363/collection1/'
[junit4:junit4]   2> 4411 T75 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty2-1355270177363/collection1/lib/README' to classloader
[junit4:junit4]   2> 4412 T75 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty2-1355270177363/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 4460 T75 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 4502 T75 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 4504 T75 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 4525 T75 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 4698 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4700 T43 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:45218_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:45218/solr"}
[junit4:junit4]   2> 4706 T74 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4706 T59 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4706 T42 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4860 T75 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 4869 T75 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 4872 T75 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 4902 T75 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 4907 T75 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 4912 T75 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 4917 T75 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 4922 T75 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355270177363/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty2/
[junit4:junit4]   2> 4922 T75 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bb8a8c6
[junit4:junit4]   2> 4924 T75 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty2/index/
[junit4:junit4]   2> 4925 T75 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 4926 T75 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty2/index forceNew:false
[junit4:junit4]   2> 4932 T75 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3b63ecdd; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 4933 T75 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 4934 T75 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 4939 T75 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 4939 T75 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 4940 T75 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 4942 T75 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 4943 T75 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 4944 T75 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 4945 T75 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 4946 T75 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 4948 T75 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 4949 T75 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 4951 T75 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 4951 T75 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 4953 T75 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 4953 T75 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 4953 T75 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 4955 T75 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 4956 T75 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4957 T75 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4959 T75 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4960 T75 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4961 T75 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4963 T75 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4964 T75 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4966 T75 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 4967 T75 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 4969 T75 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 4971 T75 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 4973 T75 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 4977 T75 oass.SolrIndexSearcher.<init> Opening Searcher@c63dc7c main
[junit4:junit4]   2> 4977 T75 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 4979 T75 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 4979 T75 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 4981 T75 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 4985 T75 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 5042 T76 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@c63dc7c main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 5058 T75 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 5058 T75 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 5214 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5216 T43 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:38136_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:38136/solr"}
[junit4:junit4]   2> 5216 T43 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 5216 T43 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4]   2> 5223 T74 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5224 T59 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5224 T42 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5560 T75 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 5561 T75 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:38136/solr shardId:shard2
[junit4:junit4]   2> 5563 T75 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4]   2> 5575 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b2230007 type:delete cxid:0x44 zxid:0x7e txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard2 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard2
[junit4:junit4]   2> 5575 T75 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 5576 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b2230007 type:create cxid:0x45 zxid:0x7f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5579 T75 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 5580 T75 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 5581 T75 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:38136/solr/collection1/
[junit4:junit4]   2> 5581 T75 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 5582 T75 oasc.SyncStrategy.syncToMe http://127.0.0.1:38136/solr/collection1/ has no replicas
[junit4:junit4]   2> 5583 T75 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:38136/solr/collection1/
[junit4:junit4]   2> 5584 T75 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4]   2> 5591 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b2230007 type:create cxid:0x4e zxid:0x82 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5730 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5836 T42 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5836 T74 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5836 T59 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5845 T75 oasc.ZkController.register We are http://127.0.0.1:38136/solr/collection1/ and leader is http://127.0.0.1:38136/solr/collection1/
[junit4:junit4]   2> 5846 T75 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:38136/solr
[junit4:junit4]   2> 5846 T75 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 5847 T75 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 5847 T75 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 5849 T75 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5851 T19 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 5852 T19 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 5852 T19 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 5931 T19 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 5934 T19 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:44139
[junit4:junit4]   2> 5935 T19 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 5935 T19 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355270178983
[junit4:junit4]   2> 5936 T19 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355270178983/'
[junit4:junit4]   2> 5954 T19 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 5955 T19 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 5956 T19 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355270178983
[junit4:junit4]   2> 5956 T19 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355270178983/solr.xml
[junit4:junit4]   2> 5957 T19 oasc.CoreContainer.<init> New CoreContainer 1689588836
[junit4:junit4]   2> 5958 T19 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355270178983/'
[junit4:junit4]   2> 5958 T19 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355270178983/'
[junit4:junit4]   2> 5988 T19 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 6000 T19 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:40680/solr
[junit4:junit4]   2> 6001 T19 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 6001 T19 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:40680 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@ebb3558
[junit4:junit4]   2> 6002 T19 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6003 T86 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:40680. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 6004 T86 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:40680, initiating session
[junit4:junit4]   2> 6004 T21 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:35887
[junit4:junit4]   2> 6004 T21 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:35887
[junit4:junit4]   2> 6005 T23 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8c65b2230008 with negotiated timeout 20000 for client /127.0.0.1:35887
[junit4:junit4]   2> 6005 T86 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:40680, sessionid = 0x13b8c65b2230008, negotiated timeout = 20000
[junit4:junit4]   2> 6006 T87 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ebb3558 name:ZooKeeperConnection Watcher:127.0.0.1:40680 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6006 T19 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6008 T24 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8c65b2230008
[junit4:junit4]   2> 6009 T87 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 6009 T19 oaz.ZooKeeper.close Session: 0x13b8c65b2230008 closed
[junit4:junit4]   2> 6009 T21 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:35887 which had sessionid 0x13b8c65b2230008
[junit4:junit4]   2> 6010 T19 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:40680/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@15571a74
[junit4:junit4]   2> 6011 T19 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6011 T88 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:40680. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 6012 T88 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:40680, initiating session
[junit4:junit4]   2> 6012 T21 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:35888
[junit4:junit4]   2> 6012 T21 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:35888
[junit4:junit4]   2> 6013 T23 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8c65b2230009 with negotiated timeout 8000 for client /127.0.0.1:35888
[junit4:junit4]   2> 6013 T88 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:40680, sessionid = 0x13b8c65b2230009, negotiated timeout = 8000
[junit4:junit4]   2> 6014 T89 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@15571a74 name:ZooKeeperConnection Watcher:127.0.0.1:40680/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6014 T19 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6015 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b2230009 type:create cxid:0x1 zxid:0x8f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6017 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b2230009 type:create cxid:0x2 zxid:0x90 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6018 T19 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44139_solr
[junit4:junit4]   2> 6019 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b2230009 type:delete cxid:0x4 zxid:0x91 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:44139_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:44139_solr
[junit4:junit4]   2> 6020 T19 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:44139_solr
[junit4:junit4]   2> 6023 T42 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 6023 T74 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 6023 T59 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 6025 T19 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 6025 T74 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 6026 T19 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 6026 T59 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 6026 T42 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 6026 T19 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 6027 T19 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 6027 T19 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 6028 T19 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 6028 T19 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 6028 T19 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 6029 T19 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 6029 T19 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 6037 T19 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 6044 T90 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355270178983/collection1
[junit4:junit4]   2> 6044 T90 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 6045 T90 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 6046 T90 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 6047 T90 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355270178983/collection1/'
[junit4:junit4]   2> 6048 T90 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty3-1355270178983/collection1/lib/README' to classloader
[junit4:junit4]   2> 6048 T90 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty3-1355270178983/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 6083 T90 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 6124 T90 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 6126 T90 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 6144 T90 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 6346 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6348 T43 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:38136_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:38136/solr"}
[junit4:junit4]   2> 6356 T74 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6356 T59 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6356 T42 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6356 T89 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6556 T90 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 6570 T90 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 6574 T90 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 6609 T90 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 6614 T90 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 6618 T90 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 6632 T90 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 6635 T90 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355270178983/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty3/
[junit4:junit4]   2> 6636 T90 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bb8a8c6
[junit4:junit4]   2> 6638 T90 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty3/index/
[junit4:junit4]   2> 6639 T90 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 6639 T90 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty3/index forceNew:false
[junit4:junit4]   2> 6707 T90 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@39731fbd; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 6708 T90 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 6708 T90 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 6711 T90 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 6711 T90 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 6712 T90 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 6712 T90 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 6713 T90 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 6713 T90 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 6714 T90 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 6715 T90 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 6717 T90 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 6718 T90 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 6719 T90 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 6720 T90 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 6721 T90 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 6721 T90 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 6722 T90 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 6723 T90 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 6724 T90 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6726 T90 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6727 T90 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6729 T90 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6730 T90 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6731 T90 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6733 T90 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6734 T90 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 6736 T90 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 6738 T90 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 6740 T90 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 6743 T90 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 6746 T90 oass.SolrIndexSearcher.<init> Opening Searcher@3e6bb568 main
[junit4:junit4]   2> 6746 T90 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 6747 T90 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 6748 T90 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 6749 T90 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 6753 T90 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 6795 T91 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3e6bb568 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 6806 T90 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 6807 T90 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 6865 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6866 T43 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:44139_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:44139/solr"}
[junit4:junit4]   2> 6866 T43 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 6867 T43 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 6872 T42 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6872 T89 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6872 T59 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6872 T74 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 7308 T90 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 7309 T90 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:44139/solr shardId:shard1
[junit4:junit4]   2> 7314 T90 oasc.ZkController.register We are http://127.0.0.1:44139/solr/collection1/ and leader is http://127.0.0.1:45218/solr/collection1/
[junit4:junit4]   2> 7315 T90 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:44139/solr
[junit4:junit4]   2> 7315 T90 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 7315 T90 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C2 name=collection1 org.apache.solr.core.SolrCore@14927a57 url=http://127.0.0.1:44139/solr/collection1 node=127.0.0.1:44139_solr
[junit4:junit4]   2> 7318 T92 C2 P44139 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 7319 T90 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7319 T92 C2 P44139 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 7320 T92 C2 P44139 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 7321 T92 C2 P44139 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 7321 T19 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 7322 T19 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 7322 T19 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 7322 T92 C2 P44139 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:45218/solr/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 7326 T92 C2 P44139 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4]   2> 7332 T92 C2 P44139 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:44139/solr START replicas=[http://127.0.0.1:45218/solr/collection1/] nUpdates=100
[junit4:junit4]   2> 7335 T92 C2 P44139 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 7336 T92 C2 P44139 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 7336 T92 C2 P44139 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 7336 T92 C2 P44139 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 7379 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7381 T43 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:44139_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:44139/solr"}
[junit4:junit4]   2> 7387 T74 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 7387 T59 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 7387 T89 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 7387 T42 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 7389 T19 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 7393 T19 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:52508
[junit4:junit4]   2> 7394 T19 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 7394 T19 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355270180453
[junit4:junit4]   2> 7395 T19 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355270180453/'
[junit4:junit4]   2> 7412 T19 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 7413 T19 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 7413 T19 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355270180453
[junit4:junit4]   2> 7414 T19 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355270180453/solr.xml
[junit4:junit4]   2> 7414 T19 oasc.CoreContainer.<init> New CoreContainer 2085347999
[junit4:junit4]   2> 7414 T19 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355270180453/'
[junit4:junit4]   2> 7415 T19 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355270180453/'
[junit4:junit4]   2> 7438 T19 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 7452 T19 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:40680/solr
[junit4:junit4]   2> 7452 T19 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 7453 T19 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:40680 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@4527769a
[junit4:junit4]   2> 7455 T103 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:40680. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 7455 T19 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 7456 T103 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:40680, initiating session
[junit4:junit4]   2> 7456 T21 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:35889
[junit4:junit4]   2> 7457 T21 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:35889
[junit4:junit4]   2> 7458 T23 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8c65b223000a with negotiated timeout 20000 for client /127.0.0.1:35889
[junit4:junit4]   2> 7458 T103 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:40680, sessionid = 0x13b8c65b223000a, negotiated timeout = 20000
[junit4:junit4]   2> 7459 T104 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4527769a name:ZooKeeperConnection Watcher:127.0.0.1:40680 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 7459 T19 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 7462 T24 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8c65b223000a
[junit4:junit4]   2> 7463 T104 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 7464 T21 oazs.NIOServerCnxn.doIO WARNING caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13b8c65b223000a, likely client has closed socket
[junit4:junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 
[junit4:junit4]   2> 7463 T19 oaz.ZooKeeper.close Session: 0x13b8c65b223000a closed
[junit4:junit4]   2> 7468 T21 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:35889 which had sessionid 0x13b8c65b223000a
[junit4:junit4]   2> 7468 T19 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:40680/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@478f6f48
[junit4:junit4]   2> 7473 T105 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:40680. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 7474 T105 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:40680, initiating session
[junit4:junit4]   2> 7474 T21 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:35890
[junit4:junit4]   2> 7475 T21 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:35890
[junit4:junit4]   2> 7476 T23 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8c65b223000b with negotiated timeout 8000 for client /127.0.0.1:35890
[junit4:junit4]   2> 7476 T105 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:40680, sessionid = 0x13b8c65b223000b, negotiated timeout = 8000
[junit4:junit4]   2> 7477 T19 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 7478 T106 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@478f6f48 name:ZooKeeperConnection Watcher:127.0.0.1:40680/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 7478 T19 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 7480 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b223000b type:create cxid:0x1 zxid:0xa6 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 7481 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b223000b type:create cxid:0x2 zxid:0xa7 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 7483 T19 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52508_solr
[junit4:junit4]   2> 7484 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b223000b type:delete cxid:0x4 zxid:0xa8 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:52508_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:52508_solr
[junit4:junit4]   2> 7485 T19 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52508_solr
[junit4:junit4]   2> 7489 T42 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 7489 T89 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 7489 T74 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 7496 T42 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 7496 T89 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 7497 T74 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 7499 T19 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 7500 T19 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 7500 T59 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 7500 T19 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 7501 T19 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 7502 T19 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 7502 T19 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 7503 T19 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 7503 T19 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 7504 T19 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 7505 T19 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 7514 T59 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 7522 T19 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 7531 T107 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355270180453/collection1
[junit4:junit4]   2> 7531 T107 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 7533 T107 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 7533 T107 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 7535 T107 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355270180453/collection1/'
[junit4:junit4]   2> 7536 T107 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty4-1355270180453/collection1/lib/README' to classloader
[junit4:junit4]   2> 7537 T107 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty4-1355270180453/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 7586 T107 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> ASYNC  NEW_CORE C3 name=collection1 org.apache.solr.core.SolrCore@13eecd31 url=http://127.0.0.1:45218/solr/collection1 node=127.0.0.1:45218_solr
[junit4:junit4]   2> 7618 T55 C3 P45218 REQ /get {distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=4 
[junit4:junit4]   2> 7630 T107 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 7631 T107 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 7646 T107 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 8003 T107 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 8012 T107 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 8015 T107 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 8044 T107 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 8050 T107 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 8057 T107 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 8062 T107 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 8066 T107 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355270180453/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty4/
[junit4:junit4]   2> 8066 T107 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bb8a8c6
[junit4:junit4]   2> 8067 T107 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty4/index/
[junit4:junit4]   2> 8068 T107 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 8069 T107 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty4/index forceNew:false
[junit4:junit4]   2> 8073 T107 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@36d5ee2; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 8074 T107 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 8074 T107 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 8077 T107 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 8078 T107 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 8078 T107 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 8078 T107 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 8079 T107 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 8079 T107 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 8080 T107 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 8081 T107 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 8082 T107 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 8083 T107 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 8084 T107 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 8085 T107 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 8086 T107 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 8086 T107 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 8087 T107 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 8088 T107 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 8089 T107 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8090 T107 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8091 T107 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8093 T107 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8094 T107 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8096 T107 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8097 T107 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8098 T107 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 8099 T107 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 8102 T107 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 8104 T107 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 8110 T107 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 8114 T107 oass.SolrIndexSearcher.<init> Opening Searcher@7ff1bfd0 main
[junit4:junit4]   2> 8114 T107 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 8115 T107 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 8116 T107 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 8117 T107 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 8122 T107 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 8159 T108 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7ff1bfd0 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 8179 T107 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 8179 T107 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 8397 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8399 T43 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:52508_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:52508/solr"}
[junit4:junit4]   2> 8399 T43 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 8399 T43 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4]   2> 8406 T74 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8406 T89 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8406 T42 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8406 T59 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8406 T106 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8682 T107 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 8682 T107 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:52508/solr shardId:shard2
[junit4:junit4]   2> 8687 T107 oasc.ZkController.register We are http://127.0.0.1:52508/solr/collection1/ and leader is http://127.0.0.1:38136/solr/collection1/
[junit4:junit4]   2> 8687 T107 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:52508/solr
[junit4:junit4]   2> 8687 T107 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 8687 T107 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C4 name=collection1 org.apache.solr.core.SolrCore@159e752 url=http://127.0.0.1:52508/solr/collection1 node=127.0.0.1:52508_solr
[junit4:junit4]   2> 8688 T109 C4 P52508 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 8689 T109 C4 P52508 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 8689 T107 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8689 T109 C4 P52508 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 8689 T109 C4 P52508 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 8690 T19 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 8691 T109 C4 P52508 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:38136/solr/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 8691 T19 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 8691 T109 C4 P52508 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:52508/solr START replicas=[http://127.0.0.1:38136/solr/collection1/] nUpdates=100
[junit4:junit4]   2> 8692 T19 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 8692 T109 C4 P52508 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 8692 T109 C4 P52508 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 8693 T109 C4 P52508 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 8693 T109 C4 P52508 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C5 name=collection1 org.apache.solr.core.SolrCore@6cb9b841 url=http://127.0.0.1:38136/solr/collection1 node=127.0.0.1:38136_solr
[junit4:junit4]   2> 8700 T67 C5 P38136 REQ /get {distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=0 
[junit4:junit4]   2> 8702 T19 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:40680/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@220d53c
[junit4:junit4]   2> 8703 T19 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 8703 T111 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:40680. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 8704 T111 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:40680, initiating session
[junit4:junit4]   2> 8704 T21 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:35895
[junit4:junit4]   2> 8705 T21 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:35895
[junit4:junit4]   2> 8706 T23 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8c65b223000c with negotiated timeout 10000 for client /127.0.0.1:35895
[junit4:junit4]   2> 8706 T111 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:40680, sessionid = 0x13b8c65b223000c, negotiated timeout = 10000
[junit4:junit4]   2> 8707 T112 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@220d53c name:ZooKeeperConnection Watcher:127.0.0.1:40680/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 8707 T19 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 8708 T19 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 8713 T19 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 8714 T19 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 8719 T19 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8722 T19 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):540
[junit4:junit4]   2> 8723 T19 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8913 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8915 T43 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:52508_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:52508/solr"}
[junit4:junit4]   2> 8941 T74 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8941 T106 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8941 T112 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8941 T59 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8942 T42 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8941 T89 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2>  C2_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:44139_solr, base_url=http://127.0.0.1:44139/solr}
[junit4:junit4]   2> 9654 T92 C2 P44139 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 9655 T92 C2 P44139 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 9655 T92 C2 P44139 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:45218/solr/collection1/. core=collection1
[junit4:junit4]   2> 9655 T92 C2 P44139 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 9667 T53 C3 P45218 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16
[junit4:junit4]   2> 9671 T53 C3 P45218 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 9674 T53 C3 P45218 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@28f1d4e2; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 9674 T53 C3 P45218 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 9726 T19 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9756 T53 C3 P45218 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@28f1d4e2; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@28f1d4e2; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 9756 T53 C3 P45218 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 9757 T53 C3 P45218 oass.SolrIndexSearcher.<init> Opening Searcher@500d68b realtime
[junit4:junit4]   2> 9758 T53 C3 P45218 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 9758 T53 C3 P45218 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 9759 T53 C3 P45218 /update {waitSearcher=true&openSearcher=false&commit=true&commit_end_point=true&wt=javabin&softCommit=false&version=2} {commit=} 0 94
[junit4:junit4]   2> 9774 T92 C2 P44139 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 9775 T92 C2 P44139 oascsi.HttpClientUtil.createClient Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
[junit4:junit4]   2> 9780 T92 C2 P44139 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 9794 T55 C3 P45218 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 9794 T55 C3 P45218 REQ /replication {command=indexversion&wt=javabin&qt=/replication&version=2} status=0 QTime=12 
[junit4:junit4]   2> 9796 T92 C2 P44139 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 9796 T92 C2 P44139 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 9796 T92 C2 P44139 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 9800 T53 C3 P45218 REQ /replication {command=filelist&generation=2&wt=javabin&qt=/replication&version=2} status=0 QTime=1 
[junit4:junit4]   2> 9801 T92 C2 P44139 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 9802 T92 C2 P44139 oash.SnapPuller.fetchLatestIndex Starting download to ./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty3/index.20121211195622927 fullCopy=true
[junit4:junit4]   2> 9807 T52 C3 P45218 REQ /replication {file=segments_2&command=filecontent&checksum=true&generation=2&qt=/replication&wt=filestream} status=0 QTime=1 
[junit4:junit4]   2> 9812 T92 C2 P44139 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 9816 T92 C2 P44139 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20121211195622927
[junit4:junit4]   2> 9821 T92 C2 P44139 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty3/index/ new=./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty3/index.20121211195622927
[junit4:junit4]   2> 9822 T92 C2 P44139 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty3/index.20121211195622927 forceNew:false
[junit4:junit4]   2> 9824 T92 C2 P44139 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty3/index.20121211195622927 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3290dd1b; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 9825 T92 C2 P44139 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 9827 T92 C2 P44139 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 9827 T92 C2 P44139 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 9827 T92 C2 P44139 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4]   2> 9828 T92 C2 P44139 oasc.CachingDirectoryFactory.close Closing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty3/index.20121211195622927
[junit4:junit4]   2> 9829 T92 C2 P44139 oash.SnapPuller$2.onClose removing old index directory ./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty3/index
[junit4:junit4]   2> 9830 T92 C2 P44139 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty3/index.20121211195622927 forceNew:true
[junit4:junit4]   2> 9832 T92 C2 P44139 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty3/index.20121211195622927 lockFactory=org.apache.lucene.store.NativeFSLockFactory@40fc2376; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 9832 T92 C2 P44139 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 9832 T92 C2 P44139 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 9833 T92 C2 P44139 oass.SolrIndexSearcher.<init> Opening Searcher@5a9665fc main
[junit4:junit4]   2> 9833 T92 C2 P44139 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 9836 T91 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5a9665fc main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 9837 T92 C2 P44139 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 9857 T92 C2 P44139 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty3/index.20121211195622927 lockFactory=org.apache.lucene.store.NativeFSLockFactory@40fc2376; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty3/index.20121211195622927 lockFactory=org.apache.lucene.store.NativeFSLockFactory@40fc2376; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 9858 T92 C2 P44139 oasc.SolrDeletionPolicy.updateCommits newest commit = 3
[junit4:junit4]   2> 9858 T92 C2 P44139 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 9859 T92 C2 P44139 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 9859 T92 C2 P44139 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 9859 T92 C2 P44139 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 9859 T92 C2 P44139 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 9861 T92 C2 P44139 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 9952 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9954 T43 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:44139_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:44139/solr"}
[junit4:junit4]   2> 9986 T112 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9986 T74 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9987 T106 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9987 T42 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9986 T89 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9987 T59 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10728 T19 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2>  C4_STATE=coll:collection1 core:collection1 props:{shard=shard2, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:52508_solr, base_url=http://127.0.0.1:52508/solr}
[junit4:junit4]   2> 11706 T109 C4 P52508 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 11707 T109 C4 P52508 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 11707 T109 C4 P52508 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:38136/solr/collection1/. core=collection1
[junit4:junit4]   2> 11707 T109 C4 P52508 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 11718 T69 C5 P38136 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 11721 T69 C5 P38136 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3b63ecdd; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 11722 T69 C5 P38136 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 11731 T19 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 11766 T69 C5 P38136 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3b63ecdd; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3b63ecdd; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 11766 T69 C5 P38136 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 11767 T69 C5 P38136 oass.SolrIndexSearcher.<init> Opening Searcher@14446bce realtime
[junit4:junit4]   2> 11767 T69 C5 P38136 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 11768 T69 C5 P38136 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 11768 T69 C5 P38136 /update {waitSearcher=true&openSearcher=false&commit=true&commit_end_point=true&wt=javabin&softCommit=false&version=2} {commit=} 0 51
[junit4:junit4]   2> 11770 T109 C4 P52508 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 11771 T109 C4 P52508 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 11774 T67 C5 P38136 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 11775 T67 C5 P38136 REQ /replication {command=indexversion&wt=javabin&qt=/replication&version=2} status=0 QTime=2 
[junit4:junit4]   2> 11776 T109 C4 P52508 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 11776 T109 C4 P52508 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 11776 T109 C4 P52508 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 11779 T68 C5 P38136 REQ /replication {command=filelist&generation=2&wt=javabin&qt=/replication&version=2} status=0 QTime=0 
[junit4:junit4]   2> 11780 T109 C4 P52508 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 11781 T109 C4 P52508 oash.SnapPuller.fetchLatestIndex Starting download to ./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty4/index.20121211195624907 fullCopy=true
[junit4:junit4]   2> 11786 T69 C5 P38136 REQ /replication {file=segments_2&command=filecontent&checksum=true&generation=2&qt=/replication&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 11792 T109 C4 P52508 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 11796 T109 C4 P52508 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20121211195624907
[junit4:junit4]   2> 11797 T109 C4 P52508 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty4/index/ new=./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty4/index.20121211195624907
[junit4:junit4]   2> 11798 T109 C4 P52508 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty4/index.20121211195624907 forceNew:false
[junit4:junit4]   2> 11800 T109 C4 P52508 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty4/index.20121211195624907 lockFactory=org.apache.lucene.store.NativeFSLockFactory@194206c9; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 11801 T109 C4 P52508 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 11802 T109 C4 P52508 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 11802 T109 C4 P52508 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 11803 T109 C4 P52508 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4]   2> 11803 T109 C4 P52508 oasc.CachingDirectoryFactory.close Closing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty4/index.20121211195624907
[junit4:junit4]   2> 11804 T109 C4 P52508 oash.SnapPuller$2.onClose removing old index directory ./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty4/index
[junit4:junit4]   2> 11805 T109 C4 P52508 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty4/index.20121211195624907 forceNew:true
[junit4:junit4]   2> 11808 T109 C4 P52508 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty4/index.20121211195624907 lockFactory=org.apache.lucene.store.NativeFSLockFactory@444f0429; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 11808 T109 C4 P52508 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 11808 T109 C4 P52508 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 11809 T109 C4 P52508 oass.SolrIndexSearcher.<init> Opening Searcher@489668ad main
[junit4:junit4]   2> 11809 T109 C4 P52508 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 11812 T108 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@489668ad main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 11813 T109 C4 P52508 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 11827 T109 C4 P52508 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty4/index.20121211195624907 lockFactory=org.apache.lucene.store.NativeFSLockFactory@444f0429; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty4/index.20121211195624907 lockFactory=org.apache.lucene.store.NativeFSLockFactory@444f0429; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 11829 T109 C4 P52508 oasc.SolrDeletionPolicy.updateCommits newest commit = 3
[junit4:junit4]   2> 11830 T109 C4 P52508 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 11830 T109 C4 P52508 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 11830 T109 C4 P52508 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 11830 T109 C4 P52508 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 11831 T109 C4 P52508 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 11832 T109 C4 P52508 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 12005 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 12006 T43 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:52508_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:52508/solr"}
[junit4:junit4]   2> 12011 T112 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 12011 T42 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 12011 T59 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 12011 T74 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 12011 T89 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 12011 T106 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 12735 T19 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> ASYNC  NEW_CORE C6 name=collection1 org.apache.solr.core.SolrCore@595188bf url=http://127.0.0.1:40765/solr/collection1 node=127.0.0.1:40765_solr
[junit4:junit4]   2> 12770 T36 C6 P40765 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1d85813a; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 12771 T36 C6 P40765 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 12778 T36 C6 P40765 oass.SolrIndexSearcher.<init> Opening Searcher@6dd28655 realtime
[junit4:junit4]   2> 12779 T36 C6 P40765 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 12780 T36 C6 P40765 /update {wt=javabin&version=2} {deleteByQuery=*:* (-1421103790437695488)} 0 25
[junit4:junit4]   2> 12781 T19 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:40680/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@3f1fd75a
[junit4:junit4]   2> 12782 T19 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 12782 T115 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:40680. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 12782 T115 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:40680, initiating session
[junit4:junit4]   2> 12783 T21 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:35913
[junit4:junit4]   2> 12783 T21 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:35913
[junit4:junit4]   2> 12784 T23 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8c65b223000d with negotiated timeout 10000 for client /127.0.0.1:35913
[junit4:junit4]   2> 12784 T115 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:40680, sessionid = 0x13b8c65b223000d, negotiated timeout = 10000
[junit4:junit4]   2> 12785 T116 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3f1fd75a name:ZooKeeperConnection Watcher:127.0.0.1:40680/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 12785 T19 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 12786 T19 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2>  C2_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:44139_solr, base_url=http://127.0.0.1:44139/solr}
[junit4:junit4]   2> 12809 T83 C2 P44139 REQ /update {update.distrib=FROMLEADER&_version_=-1421103790471249920&update.from=http://127.0.0.1:45218/solr/collection1/&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2>  C4_STATE=coll:collection1 core:collection1 props:{shard=shard2, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:52508_solr, base_url=http://127.0.0.1:52508/solr}
[junit4:junit4]   2> 12811 T102 C4 P52508 REQ /update {update.distrib=FROMLEADER&_version_=-1421103790481735680&update.from=htt

[...truncated too long message...]

ting.SeedInfo.seed([A672C1073219D55D:27944F1F4546B561]:0)
[junit4:junit4]    > 	at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:165)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:115)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:110)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:563)
[junit4:junit4]    > 	at org.apache.solr.cloud.BasicDistributedZk2Test.brindDownShardIndexSomeDocsAndRecover(BasicDistributedZk2Test.java:321)
[junit4:junit4]    > 	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:83)
[junit4:junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:601)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 567393 T1974 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> NOTE: test params are: codec=FastDecompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST_DECOMPRESSION, chunkSize=12)), sim=RandomSimilarityProvider(queryNorm=false,coord=yes): {}, locale=is, timezone=America/La_Paz
[junit4:junit4]   2> NOTE: Linux 3.2.0-34-generic amd64/Oracle Corporation 1.7.0_09 (64-bit)/cpus=8,threads=2,free=94272064,total=434110464
[junit4:junit4]   2> NOTE: All tests run in this JVM: [HighlighterConfigTest, SpellCheckCollatorTest, BasicDistributedZkTest, SpellCheckComponentTest, CopyFieldTest, PreAnalyzedFieldTest, TestExtendedDismaxParser, TestLFUCache, TestDefaultSimilarityFactory, WordBreakSolrSpellCheckerTest, TestAnalyzedSuggestions, TestLuceneMatchVersion, DistributedSpellCheckComponentTest, SpellPossibilityIteratorTest, TestLMJelinekMercerSimilarityFactory, JsonLoaderTest, MBeansHandlerTest, TestIndexingPerformance, AnalysisAfterCoreReloadTest, TestQueryTypes, TestBadConfig, TestWordDelimiterFilterFactory, SystemInfoHandlerTest, TestXIncludeConfig, TestFastOutputStream, NumericFieldsTest, TestElisionMultitermQuery, TermsComponentTest, ZkControllerTest, TestConfig, MinimalSchemaTest, MoreLikeThisHandlerTest, TestSystemIdResolver, TestFaceting, TestGroupingSearch, TestFastWriter, NotRequiredUniqueKeyTest, SimpleFacetsTest, TestSearchPerf, IndexBasedSpellCheckerTest, TestPerFieldSimilarity, TestQuerySenderNoQuery, PluginInfoTest, CircularListTest, TestStressReorder, SimplePostToolTest, BadComponentTest, SuggesterFSTTest, TestPHPSerializedResponseWriter, FieldAnalysisRequestHandlerTest, SuggesterWFSTTest, TestBinaryResponseWriter, SearchHandlerTest, AlternateDirectoryTest, TestJmxMonitoredMap, TestRealTimeGet, TestDistributedSearch, SoftAutoCommitTest, AutoCommitTest, ZkSolrClientTest, TestHashPartitioner, StatsComponentTest, TestRecovery, SolrCoreTest, TestRangeQuery, DirectUpdateHandlerTest, TestCoreContainer, TestSort, DirectSolrSpellCheckerTest, TestFiltering, FileBasedSpellCheckerTest, ConvertedLegacyTest, PeerSyncTest, QueryElevationComponentTest, SortByFunctionTest, SignatureUpdateProcessorFactoryTest, TestJmxIntegration, TestFunctionQuery, QueryEqualityTest, TestCSVResponseWriter, TestPseudoReturnFields, IndexSchemaTest, QueryParsingTest, PingRequestHandlerTest, TermVectorComponentTest, DocumentAnalysisRequestHandlerTest, IndexSchemaRuntimeFieldTest, SolrPluginUtilsTest, FastVectorHighlighterTest, TestReversedWildcardFilterFactory, TestOmitPositions, TestQueryUtils, LoggingHandlerTest, SolrCmdDistributorTest, CSVRequestHandlerTest, BadIndexSchemaTest, UpdateRequestProcessorFactoryTest, PrimitiveFieldTypeTest, SOLR749Test, DefaultValueUpdateProcessorTest, SolrIndexConfigTest, TestLMDirichletSimilarityFactory, TestCodecSupport, TestFastLRUCache, URLClassifyProcessorTest, FileUtilsTest, TestSuggestSpellingConverter, RAMDirectoryFactoryTest, TestDocumentBuilder, BasicDistributedZk2Test]
[junit4:junit4] Completed on J0 in 567.41s, 1 test, 1 failure <<< FAILURES!

[...truncated 11 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:352: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:178: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:438: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1171: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:835: There were test failures: 239 suites, 994 tests, 1 error, 1 failure, 7 ignored (2 assumptions)

Total time: 32 minutes 46 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 64bit/jdk1.7.0_09 -XX:+UseParallelGC
Email was triggered for: Failure
Sending email for trigger: Failure



Re: [JENKINS] Lucene-Solr-4.x-Linux (32bit/ibm-j9-jdk7) - Build # 3191 - Still Failing!

Posted by Robert Muir <rc...@gmail.com>.
Maybe my little refactoring of FST pack() yesterday exposed the JVM bug again?

On Wed, Dec 12, 2012 at 7:42 PM, Uwe Schindler <uw...@thetaphi.de> wrote:
> The FST.pack() J9 bug is pack ähm back :-)
>
> -----
> Uwe Schindler
> H.-H.-Meier-Allee 63, D-28213 Bremen
> http://www.thetaphi.de
> eMail: uwe@thetaphi.de
>
>
>> -----Original Message-----
>> From: Michael McCandless [mailto:lucene@mikemccandless.com]
>> Sent: Thursday, December 13, 2012 1:29 AM
>> To: dev@lucene.apache.org
>> Cc: yonik@apache.org; jpountz@apache.org
>> Subject: Re: [JENKINS] Lucene-Solr-4.x-Linux (32bit/ibm-j9-jdk7) - Build #
>> 3191 - Still Failing!
>>
>> Can anyone reproduce this?
>>
>> Mike McCandless
>>
>> http://blog.mikemccandless.com
>>
>> On Wed, Dec 12, 2012 at 6:18 PM, Policeman Jenkins Server
>> <je...@sd-datasolutions.de> wrote:
>> > Build: http://jenkins.sd-datasolutions.de/job/Lucene-Solr-4.x-Linux/3191/
>> > Java: 32bit/ibm-j9-jdk7
>> >
>> > 14 tests failed.
>> > REGRESSION:
>> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testBGSearchTask
>> Threads
>> >
>> > Error Message:
>> >
>> >
>> > Stack Trace:
>> > java.lang.AssertionError
>> >         at
>> __randomizedtesting.SeedInfo.seed([900F08B0BE490539:4D3ACD6C068AD49
>> B]:0)
>> >         at
>> org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWr
>> iter.java:73)
>> >         at
>> org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
>> >         at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
>> >         at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
>> >         at
>> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.fi
>> nish(MemoryPostingsFormat.java:271)
>> >         at
>> org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTerm
>> sWriterPerField.java:553)
>> >         at
>> org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.j
>> ava:85)
>> >         at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
>> >         at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
>> >         at
>> org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
>> >         at
>> org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWrit
>> erPerThread.java:488)
>> >         at
>> org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:4
>> 22)
>> >         at
>> org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWrit
>> er.java:559)
>> >         at
>> org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
>> >         at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
>> >         at
>> org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1619)
>> >         at
>> org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1595)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.ForceMergeTask.doLogic(Force
>> MergeTask.java:41)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:143)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
>> kSequence.java:197)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
>> uence.java:138)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:143)
>> >         at
>> org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.jav
>> a:301)
>> >         at
>> org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:
>> 77)
>> >         at
>> org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(Bench
>> markTestCase.java:83)
>> >         at
>> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testBGSearchTask
>> Threads(TestPerfTasksLogic.java:157)
>> >         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> >         at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
>> ava:88)
>> >         at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
>> sorImpl.java:55)
>> >         at java.lang.reflect.Method.invoke(Method.java:613)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize
>> dRunner.java:1559)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Rando
>> mizedRunner.java:79)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando
>> mizedRunner.java:737)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando
>> mizedRunner.java:773)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando
>> mizedRunner.java:787)
>> >         at
>> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule
>> SetupTeardownChained.java:50)
>> >         at
>> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCa
>> cheSanity.java:51)
>> >         at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
>> fterRule.java:46)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
>> .evaluate(SystemPropertiesInvariantRule.java:55)
>> >         at
>> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
>> readAndTestName.java:49)
>> >         at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
>> IgnoreAfterMaxFailures.java:70)
>> >         at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
>> .java:48)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
>> run(ThreadLeakControl.java:358)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask
>> (ThreadLeakControl.java:782)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadL
>> eakControl.java:442)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran
>> domizedRunner.java:746)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Rando
>> mizedRunner.java:648)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Rando
>> mizedRunner.java:682)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Rando
>> mizedRunner.java:693)
>> >         at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
>> fterRule.java:46)
>> >         at
>> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreCl
>> assName.java:42)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
>> .evaluate(SystemPropertiesInvariantRule.java:55)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
>> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
>> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> >         at
>> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAss
>> ertionsRequired.java:43)
>> >         at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
>> .java:48)
>> >         at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
>> IgnoreAfterMaxFailures.java:70)
>> >         at
>> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnore
>> TestSuites.java:55)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
>> run(ThreadLeakControl.java:358)
>> >         at java.lang.Thread.run(Thread.java:780)
>> >
>> >
>> > REGRESSION:
>> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testExhaustConte
>> ntSource
>> >
>> > Error Message:
>> >
>> >
>> > Stack Trace:
>> > java.lang.AssertionError
>> >         at
>> __randomizedtesting.SeedInfo.seed([900F08B0BE490539:28FE72D1146C5FA0
>> ]:0)
>> >         at
>> org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWr
>> iter.java:73)
>> >         at
>> org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
>> >         at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
>> >         at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
>> >         at
>> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.fi
>> nish(MemoryPostingsFormat.java:271)
>> >         at
>> org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTerm
>> sWriterPerField.java:553)
>> >         at
>> org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.j
>> ava:85)
>> >         at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
>> >         at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
>> >         at
>> org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
>> >         at
>> org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWrit
>> erPerThread.java:488)
>> >         at
>> org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:4
>> 22)
>> >         at
>> org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWrit
>> er.java:559)
>> >         at
>> org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
>> >         at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
>> >         at
>> org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1619)
>> >         at
>> org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1595)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.ForceMergeTask.doLogic(Force
>> MergeTask.java:41)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:143)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
>> kSequence.java:197)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
>> uence.java:138)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:143)
>> >         at
>> org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.jav
>> a:301)
>> >         at
>> org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:
>> 77)
>> >         at
>> org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(Bench
>> markTestCase.java:83)
>> >         at
>> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testExhaustConte
>> ntSource(TestPerfTasksLogic.java:304)
>> >         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> >         at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
>> ava:88)
>> >         at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
>> sorImpl.java:55)
>> >         at java.lang.reflect.Method.invoke(Method.java:613)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize
>> dRunner.java:1559)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Rando
>> mizedRunner.java:79)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando
>> mizedRunner.java:737)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando
>> mizedRunner.java:773)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando
>> mizedRunner.java:787)
>> >         at
>> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule
>> SetupTeardownChained.java:50)
>> >         at
>> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCa
>> cheSanity.java:51)
>> >         at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
>> fterRule.java:46)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
>> .evaluate(SystemPropertiesInvariantRule.java:55)
>> >         at
>> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
>> readAndTestName.java:49)
>> >         at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
>> IgnoreAfterMaxFailures.java:70)
>> >         at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
>> .java:48)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
>> run(ThreadLeakControl.java:358)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask
>> (ThreadLeakControl.java:782)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadL
>> eakControl.java:442)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran
>> domizedRunner.java:746)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Rando
>> mizedRunner.java:648)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Rando
>> mizedRunner.java:682)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Rando
>> mizedRunner.java:693)
>> >         at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
>> fterRule.java:46)
>> >         at
>> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreCl
>> assName.java:42)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
>> .evaluate(SystemPropertiesInvariantRule.java:55)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
>> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
>> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> >         at
>> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAss
>> ertionsRequired.java:43)
>> >         at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
>> .java:48)
>> >         at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
>> IgnoreAfterMaxFailures.java:70)
>> >         at
>> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnore
>> TestSuites.java:55)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
>> run(ThreadLeakControl.java:358)
>> >         at java.lang.Thread.run(Thread.java:780)
>> >
>> >
>> > REGRESSION:
>> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testExhaustedLoo
>> ped
>> >
>> > Error Message:
>> >
>> >
>> > Stack Trace:
>> > java.lang.AssertionError
>> >         at
>> __randomizedtesting.SeedInfo.seed([900F08B0BE490539:1AE3BB949772D23
>> F]:0)
>> >         at
>> org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWr
>> iter.java:73)
>> >         at
>> org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
>> >         at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
>> >         at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
>> >         at
>> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.fi
>> nish(MemoryPostingsFormat.java:271)
>> >         at
>> org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTerm
>> sWriterPerField.java:553)
>> >         at
>> org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.j
>> ava:85)
>> >         at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
>> >         at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
>> >         at
>> org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
>> >         at
>> org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWrit
>> erPerThread.java:488)
>> >         at
>> org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:4
>> 22)
>> >         at
>> org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWrit
>> er.java:559)
>> >         at
>> org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
>> >         at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
>> >         at
>> org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:913)
>> >         at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:868)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.CloseIndexTask.doLogic(CloseIn
>> dexTask.java:48)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:143)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
>> kSequence.java:197)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
>> uence.java:138)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:143)
>> >         at
>> org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.jav
>> a:301)
>> >         at
>> org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:
>> 77)
>> >         at
>> org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(Bench
>> markTestCase.java:83)
>> >         at
>> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testExhaustedLoo
>> ped(TestPerfTasksLogic.java:583)
>> >         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> >         at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
>> ava:88)
>> >         at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
>> sorImpl.java:55)
>> >         at java.lang.reflect.Method.invoke(Method.java:613)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize
>> dRunner.java:1559)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Rando
>> mizedRunner.java:79)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando
>> mizedRunner.java:737)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando
>> mizedRunner.java:773)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando
>> mizedRunner.java:787)
>> >         at
>> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule
>> SetupTeardownChained.java:50)
>> >         at
>> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCa
>> cheSanity.java:51)
>> >         at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
>> fterRule.java:46)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
>> .evaluate(SystemPropertiesInvariantRule.java:55)
>> >         at
>> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
>> readAndTestName.java:49)
>> >         at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
>> IgnoreAfterMaxFailures.java:70)
>> >         at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
>> .java:48)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
>> run(ThreadLeakControl.java:358)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask
>> (ThreadLeakControl.java:782)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadL
>> eakControl.java:442)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran
>> domizedRunner.java:746)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Rando
>> mizedRunner.java:648)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Rando
>> mizedRunner.java:682)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Rando
>> mizedRunner.java:693)
>> >         at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
>> fterRule.java:46)
>> >         at
>> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreCl
>> assName.java:42)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
>> .evaluate(SystemPropertiesInvariantRule.java:55)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
>> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
>> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> >         at
>> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAss
>> ertionsRequired.java:43)
>> >         at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
>> .java:48)
>> >         at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
>> IgnoreAfterMaxFailures.java:70)
>> >         at
>> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnore
>> TestSuites.java:55)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
>> run(ThreadLeakControl.java:358)
>> >         at java.lang.Thread.run(Thread.java:780)
>> >
>> >
>> > REGRESSION:
>> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testIndexAndSear
>> chTasks
>> >
>> > Error Message:
>> >
>> >
>> > Stack Trace:
>> > java.lang.AssertionError
>> >         at
>> __randomizedtesting.SeedInfo.seed([900F08B0BE490539:E3C813A59FA3EB2
>> 1]:0)
>> >         at
>> org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWr
>> iter.java:73)
>> >         at
>> org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
>> >         at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
>> >         at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
>> >         at
>> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.fi
>> nish(MemoryPostingsFormat.java:271)
>> >         at
>> org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTerm
>> sWriterPerField.java:553)
>> >         at
>> org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.j
>> ava:85)
>> >         at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
>> >         at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
>> >         at
>> org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
>> >         at
>> org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWrit
>> erPerThread.java:488)
>> >         at
>> org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:4
>> 22)
>> >         at
>> org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWrit
>> er.java:559)
>> >         at
>> org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
>> >         at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
>> >         at
>> org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1619)
>> >         at
>> org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1595)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.ForceMergeTask.doLogic(Force
>> MergeTask.java:41)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:143)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
>> kSequence.java:197)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
>> uence.java:138)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:143)
>> >         at
>> org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.jav
>> a:301)
>> >         at
>> org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:
>> 77)
>> >         at
>> org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(Bench
>> markTestCase.java:83)
>> >         at
>> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testIndexAndSear
>> chTasks(TestPerfTasksLogic.java:98)
>> >         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> >         at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
>> ava:88)
>> >         at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
>> sorImpl.java:55)
>> >         at java.lang.reflect.Method.invoke(Method.java:613)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize
>> dRunner.java:1559)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Rando
>> mizedRunner.java:79)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando
>> mizedRunner.java:737)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando
>> mizedRunner.java:773)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando
>> mizedRunner.java:787)
>> >         at
>> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule
>> SetupTeardownChained.java:50)
>> >         at
>> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCa
>> cheSanity.java:51)
>> >         at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
>> fterRule.java:46)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
>> .evaluate(SystemPropertiesInvariantRule.java:55)
>> >         at
>> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
>> readAndTestName.java:49)
>> >         at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
>> IgnoreAfterMaxFailures.java:70)
>> >         at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
>> .java:48)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
>> run(ThreadLeakControl.java:358)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask
>> (ThreadLeakControl.java:782)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadL
>> eakControl.java:442)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran
>> domizedRunner.java:746)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Rando
>> mizedRunner.java:648)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Rando
>> mizedRunner.java:682)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Rando
>> mizedRunner.java:693)
>> >         at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
>> fterRule.java:46)
>> >         at
>> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreCl
>> assName.java:42)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
>> .evaluate(SystemPropertiesInvariantRule.java:55)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
>> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
>> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> >         at
>> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAss
>> ertionsRequired.java:43)
>> >         at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
>> .java:48)
>> >         at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
>> IgnoreAfterMaxFailures.java:70)
>> >         at
>> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnore
>> TestSuites.java:55)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
>> run(ThreadLeakControl.java:358)
>> >         at java.lang.Thread.run(Thread.java:780)
>> >
>> >
>> > REGRESSION:
>> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testCloseIndexFals
>> e
>> >
>> > Error Message:
>> >
>> >
>> > Stack Trace:
>> > java.lang.AssertionError
>> >         at
>> __randomizedtesting.SeedInfo.seed([900F08B0BE490539:66537D56A7655F69
>> ]:0)
>> >         at
>> org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWr
>> iter.java:73)
>> >         at
>> org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
>> >         at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
>> >         at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
>> >         at
>> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.fi
>> nish(MemoryPostingsFormat.java:271)
>> >         at
>> org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTerm
>> sWriterPerField.java:553)
>> >         at
>> org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.j
>> ava:85)
>> >         at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
>> >         at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
>> >         at
>> org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
>> >         at
>> org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWrit
>> erPerThread.java:488)
>> >         at
>> org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:4
>> 22)
>> >         at
>> org.apache.lucene.index.DocumentsWriter.postUpdate(DocumentsWriter.ja
>> va:316)
>> >         at
>> org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWr
>> iter.java:389)
>> >         at
>> org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:14
>> 58)
>> >         at
>> org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1133)
>> >         at
>> org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1114)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.AddDocTask.doLogic(AddDocTas
>> k.java:70)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:132)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
>> kSequence.java:197)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
>> uence.java:138)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:143)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
>> kSequence.java:197)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
>> uence.java:138)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:143)
>> >         at
>> org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.jav
>> a:301)
>> >         at
>> org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:
>> 77)
>> >         at
>> org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(Bench
>> markTestCase.java:83)
>> >         at
>> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testCloseIndexFals
>> e(TestPerfTasksLogic.java:620)
>> >         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> >         at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
>> ava:88)
>> >         at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
>> sorImpl.java:55)
>> >         at java.lang.reflect.Method.invoke(Method.java:613)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize
>> dRunner.java:1559)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Rando
>> mizedRunner.java:79)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando
>> mizedRunner.java:737)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando
>> mizedRunner.java:773)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando
>> mizedRunner.java:787)
>> >         at
>> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule
>> SetupTeardownChained.java:50)
>> >         at
>> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCa
>> cheSanity.java:51)
>> >         at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
>> fterRule.java:46)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
>> .evaluate(SystemPropertiesInvariantRule.java:55)
>> >         at
>> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
>> readAndTestName.java:49)
>> >         at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
>> IgnoreAfterMaxFailures.java:70)
>> >         at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
>> .java:48)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
>> run(ThreadLeakControl.java:358)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask
>> (ThreadLeakControl.java:782)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadL
>> eakControl.java:442)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran
>> domizedRunner.java:746)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Rando
>> mizedRunner.java:648)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Rando
>> mizedRunner.java:682)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Rando
>> mizedRunner.java:693)
>> >         at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
>> fterRule.java:46)
>> >         at
>> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreCl
>> assName.java:42)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
>> .evaluate(SystemPropertiesInvariantRule.java:55)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
>> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
>> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> >         at
>> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAss
>> ertionsRequired.java:43)
>> >         at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
>> .java:48)
>> >         at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
>> IgnoreAfterMaxFailures.java:70)
>> >         at
>> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnore
>> TestSuites.java:55)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
>> run(ThreadLeakControl.java:358)
>> >         at java.lang.Thread.run(Thread.java:780)
>> >
>> >
>> > REGRESSION:
>> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testHighlightingTV
>> >
>> > Error Message:
>> >
>> >
>> > Stack Trace:
>> > java.lang.AssertionError
>> >         at
>> __randomizedtesting.SeedInfo.seed([900F08B0BE490539:F02D2EC62156EDA
>> 0]:0)
>> >         at
>> org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWr
>> iter.java:73)
>> >         at
>> org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
>> >         at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
>> >         at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
>> >         at
>> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.fi
>> nish(MemoryPostingsFormat.java:271)
>> >         at
>> org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTerm
>> sWriterPerField.java:553)
>> >         at
>> org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.j
>> ava:85)
>> >         at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
>> >         at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
>> >         at
>> org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
>> >         at
>> org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWrit
>> erPerThread.java:488)
>> >         at
>> org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:4
>> 22)
>> >         at
>> org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWrit
>> er.java:559)
>> >         at
>> org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
>> >         at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
>> >         at
>> org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1619)
>> >         at
>> org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1595)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.ForceMergeTask.doLogic(Force
>> MergeTask.java:41)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:143)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
>> kSequence.java:197)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
>> uence.java:138)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:143)
>> >         at
>> org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.jav
>> a:301)
>> >         at
>> org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:
>> 77)
>> >         at
>> org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(Bench
>> markTestCase.java:83)
>> >         at
>> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testHighlightingTV
>> (TestPerfTasksLogic.java:227)
>> >         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> >         at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
>> ava:88)
>> >         at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
>> sorImpl.java:55)
>> >         at java.lang.reflect.Method.invoke(Method.java:613)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize
>> dRunner.java:1559)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Rando
>> mizedRunner.java:79)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando
>> mizedRunner.java:737)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando
>> mizedRunner.java:773)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando
>> mizedRunner.java:787)
>> >         at
>> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule
>> SetupTeardownChained.java:50)
>> >         at
>> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCa
>> cheSanity.java:51)
>> >         at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
>> fterRule.java:46)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
>> .evaluate(SystemPropertiesInvariantRule.java:55)
>> >         at
>> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
>> readAndTestName.java:49)
>> >         at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
>> IgnoreAfterMaxFailures.java:70)
>> >         at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
>> .java:48)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
>> run(ThreadLeakControl.java:358)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask
>> (ThreadLeakControl.java:782)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadL
>> eakControl.java:442)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran
>> domizedRunner.java:746)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Rando
>> mizedRunner.java:648)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Rando
>> mizedRunner.java:682)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Rando
>> mizedRunner.java:693)
>> >         at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
>> fterRule.java:46)
>> >         at
>> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreCl
>> assName.java:42)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
>> .evaluate(SystemPropertiesInvariantRule.java:55)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
>> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
>> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> >         at
>> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAss
>> ertionsRequired.java:43)
>> >         at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
>> .java:48)
>> >         at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
>> IgnoreAfterMaxFailures.java:70)
>> >         at
>> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnore
>> TestSuites.java:55)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
>> run(ThreadLeakControl.java:358)
>> >         at java.lang.Thread.run(Thread.java:780)
>> >
>> >
>> > REGRESSION:
>> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testParallelExhaus
>> ted
>> >
>> > Error Message:
>> >
>> >
>> > Stack Trace:
>> > java.lang.AssertionError
>> >         at
>> __randomizedtesting.SeedInfo.seed([900F08B0BE490539:D1A71DF46B96804
>> 5]:0)
>> >         at
>> org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWr
>> iter.java:73)
>> >         at
>> org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
>> >         at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
>> >         at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
>> >         at
>> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.fi
>> nish(MemoryPostingsFormat.java:271)
>> >         at
>> org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTerm
>> sWriterPerField.java:553)
>> >         at
>> org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.j
>> ava:85)
>> >         at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
>> >         at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
>> >         at
>> org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
>> >         at
>> org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWrit
>> erPerThread.java:488)
>> >         at
>> org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:4
>> 22)
>> >         at
>> org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWrit
>> er.java:559)
>> >         at
>> org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
>> >         at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
>> >         at
>> org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:913)
>> >         at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:868)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.CloseIndexTask.doLogic(CloseIn
>> dexTask.java:48)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:143)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
>> kSequence.java:197)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
>> uence.java:138)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:143)
>> >         at
>> org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.jav
>> a:301)
>> >         at
>> org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:
>> 77)
>> >         at
>> org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(Bench
>> markTestCase.java:83)
>> >         at
>> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testParallelExhaus
>> ted(TestPerfTasksLogic.java:546)
>> >         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> >         at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
>> ava:88)
>> >         at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
>> sorImpl.java:55)
>> >         at java.lang.reflect.Method.invoke(Method.java:613)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize
>> dRunner.java:1559)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Rando
>> mizedRunner.java:79)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando
>> mizedRunner.java:737)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando
>> mizedRunner.java:773)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando
>> mizedRunner.java:787)
>> >         at
>> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule
>> SetupTeardownChained.java:50)
>> >         at
>> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCa
>> cheSanity.java:51)
>> >         at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
>> fterRule.java:46)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
>> .evaluate(SystemPropertiesInvariantRule.java:55)
>> >         at
>> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
>> readAndTestName.java:49)
>> >         at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
>> IgnoreAfterMaxFailures.java:70)
>> >         at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
>> .java:48)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
>> run(ThreadLeakControl.java:358)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask
>> (ThreadLeakControl.java:782)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadL
>> eakControl.java:442)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran
>> domizedRunner.java:746)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Rando
>> mizedRunner.java:648)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Rando
>> mizedRunner.java:682)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Rando
>> mizedRunner.java:693)
>> >         at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
>> fterRule.java:46)
>> >         at
>> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreCl
>> assName.java:42)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
>> .evaluate(SystemPropertiesInvariantRule.java:55)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
>> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
>> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> >         at
>> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAss
>> ertionsRequired.java:43)
>> >         at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
>> .java:48)
>> >         at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
>> IgnoreAfterMaxFailures.java:70)
>> >         at
>> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnore
>> TestSuites.java:55)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
>> run(ThreadLeakControl.java:358)
>> >         at java.lang.Thread.run(Thread.java:780)
>> >
>> >
>> > REGRESSION:
>> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testHighlightingNo
>> TvNoStore
>> >
>> > Error Message:
>> >
>> >
>> > Stack Trace:
>> > java.lang.AssertionError
>> >         at
>> __randomizedtesting.SeedInfo.seed([900F08B0BE490539:2B1EF047A6586966
>> ]:0)
>> >         at
>> org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWr
>> iter.java:73)
>> >         at
>> org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
>> >         at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
>> >         at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
>> >         at
>> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.fi
>> nish(MemoryPostingsFormat.java:271)
>> >         at
>> org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTerm
>> sWriterPerField.java:553)
>> >         at
>> org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.j
>> ava:85)
>> >         at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
>> >         at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
>> >         at
>> org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
>> >         at
>> org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWrit
>> erPerThread.java:488)
>> >         at
>> org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:4
>> 22)
>> >         at
>> org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWrit
>> er.java:559)
>> >         at
>> org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
>> >         at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
>> >         at
>> org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1619)
>> >         at
>> org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1595)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.ForceMergeTask.doLogic(Force
>> MergeTask.java:41)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:143)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
>> kSequence.java:197)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
>> uence.java:138)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:143)
>> >         at
>> org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.jav
>> a:301)
>> >         at
>> org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:
>> 77)
>> >         at
>> org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(Bench
>> markTestCase.java:83)
>> >         at
>> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testHighlightingNo
>> TvNoStore(TestPerfTasksLogic.java:266)
>> >         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> >         at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
>> ava:88)
>> >         at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
>> sorImpl.java:55)
>> >         at java.lang.reflect.Method.invoke(Method.java:613)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize
>> dRunner.java:1559)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Rando
>> mizedRunner.java:79)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando
>> mizedRunner.java:737)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando
>> mizedRunner.java:773)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando
>> mizedRunner.java:787)
>> >         at
>> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule
>> SetupTeardownChained.java:50)
>> >         at
>> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCa
>> cheSanity.java:51)
>> >         at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
>> fterRule.java:46)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
>> .evaluate(SystemPropertiesInvariantRule.java:55)
>> >         at
>> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
>> readAndTestName.java:49)
>> >         at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
>> IgnoreAfterMaxFailures.java:70)
>> >         at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
>> .java:48)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
>> run(ThreadLeakControl.java:358)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask
>> (ThreadLeakControl.java:782)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadL
>> eakControl.java:442)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran
>> domizedRunner.java:746)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Rando
>> mizedRunner.java:648)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Rando
>> mizedRunner.java:682)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Rando
>> mizedRunner.java:693)
>> >         at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
>> fterRule.java:46)
>> >         at
>> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreCl
>> assName.java:42)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
>> .evaluate(SystemPropertiesInvariantRule.java:55)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
>> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
>> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> >         at
>> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAss
>> ertionsRequired.java:43)
>> >         at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
>> .java:48)
>> >         at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
>> IgnoreAfterMaxFailures.java:70)
>> >         at
>> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnore
>> TestSuites.java:55)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
>> run(ThreadLeakControl.java:358)
>> >         at java.lang.Thread.run(Thread.java:780)
>> >
>> >
>> > REGRESSION:
>> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testIndexWriterSe
>> ttings
>> >
>> > Error Message:
>> >
>> >
>> > Stack Trace:
>> > java.lang.AssertionError
>> >         at
>> __randomizedtesting.SeedInfo.seed([900F08B0BE490539:A8E67B1D32305055
>> ]:0)
>> >         at
>> org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWr
>> iter.java:73)
>> >         at
>> org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
>> >         at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
>> >         at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
>> >         at
>> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.fi
>> nish(MemoryPostingsFormat.java:271)
>> >         at
>> org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTerm
>> sWriterPerField.java:553)
>> >         at
>> org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.j
>> ava:85)
>> >         at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
>> >         at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
>> >         at
>> org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
>> >         at
>> org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWrit
>> erPerThread.java:488)
>> >         at
>> org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:4
>> 22)
>> >         at
>> org.apache.lucene.index.DocumentsWriter.postUpdate(DocumentsWriter.ja
>> va:316)
>> >         at
>> org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWr
>> iter.java:389)
>> >         at
>> org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:14
>> 58)
>> >         at
>> org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1133)
>> >         at
>> org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1114)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.AddDocTask.doLogic(AddDocTas
>> k.java:70)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:132)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
>> kSequence.java:197)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
>> uence.java:138)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:143)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
>> kSequence.java:197)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
>> uence.java:138)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:143)
>> >         at
>> org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.jav
>> a:301)
>> >         at
>> org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:
>> 77)
>> >         at
>> org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(Bench
>> markTestCase.java:83)
>> >         at
>> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testIndexWriterSe
>> ttings(TestPerfTasksLogic.java:752)
>> >         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> >         at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
>> ava:88)
>> >         at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
>> sorImpl.java:55)
>> >         at java.lang.reflect.Method.invoke(Method.java:613)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize
>> dRunner.java:1559)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Rando
>> mizedRunner.java:79)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando
>> mizedRunner.java:737)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando
>> mizedRunner.java:773)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando
>> mizedRunner.java:787)
>> >         at
>> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule
>> SetupTeardownChained.java:50)
>> >         at
>> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCa
>> cheSanity.java:51)
>> >         at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
>> fterRule.java:46)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
>> .evaluate(SystemPropertiesInvariantRule.java:55)
>> >         at
>> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
>> readAndTestName.java:49)
>> >         at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
>> IgnoreAfterMaxFailures.java:70)
>> >         at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
>> .java:48)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
>> run(ThreadLeakControl.java:358)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask
>> (ThreadLeakControl.java:782)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadL
>> eakControl.java:442)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran
>> domizedRunner.java:746)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Rando
>> mizedRunner.java:648)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Rando
>> mizedRunner.java:682)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Rando
>> mizedRunner.java:693)
>> >         at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
>> fterRule.java:46)
>> >         at
>> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreCl
>> assName.java:42)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
>> .evaluate(SystemPropertiesInvariantRule.java:55)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
>> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
>> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> >         at
>> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAss
>> ertionsRequired.java:43)
>> >         at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
>> .java:48)
>> >         at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
>> IgnoreAfterMaxFailures.java:70)
>> >         at
>> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnore
>> TestSuites.java:55)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
>> run(ThreadLeakControl.java:358)
>> >         at java.lang.Thread.run(Thread.java:780)
>> >
>> >
>> > REGRESSION:
>> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testIndexingWithF
>> acets
>> >
>> > Error Message:
>> >
>> >
>> > Stack Trace:
>> > java.lang.AssertionError
>> >         at
>> __randomizedtesting.SeedInfo.seed([900F08B0BE490539:B1ADCFFDAC233B
>> D9]:0)
>> >         at
>> org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWr
>> iter.java:73)
>> >         at
>> org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
>> >         at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
>> >         at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
>> >         at
>> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.fi
>> nish(MemoryPostingsFormat.java:271)
>> >         at
>> org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTerm
>> sWriterPerField.java:553)
>> >         at
>> org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.j
>> ava:85)
>> >         at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
>> >         at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
>> >         at
>> org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
>> >         at
>> org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWrit
>> erPerThread.java:488)
>> >         at
>> org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:4
>> 22)
>> >         at
>> org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWrit
>> er.java:559)
>> >         at
>> org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
>> >         at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
>> >         at
>> org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:913)
>> >         at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:868)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.CloseIndexTask.doLogic(CloseIn
>> dexTask.java:48)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:143)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
>> kSequence.java:197)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
>> uence.java:138)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:143)
>> >         at
>> org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.jav
>> a:301)
>> >         at
>> org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:
>> 77)
>> >         at
>> org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(Bench
>> markTestCase.java:83)
>> >         at
>> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testIndexingWithF
>> acets(TestPerfTasksLogic.java:794)
>> >         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> >         at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
>> ava:88)
>> >         at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
>> sorImpl.java:55)
>> >         at java.lang.reflect.Method.invoke(Method.java:613)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize
>> dRunner.java:1559)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Rando
>> mizedRunner.java:79)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando
>> mizedRunner.java:737)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando
>> mizedRunner.java:773)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando
>> mizedRunner.java:787)
>> >         at
>> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule
>> SetupTeardownChained.java:50)
>> >         at
>> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCa
>> cheSanity.java:51)
>> >         at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
>> fterRule.java:46)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
>> .evaluate(SystemPropertiesInvariantRule.java:55)
>> >         at
>> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
>> readAndTestName.java:49)
>> >         at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
>> IgnoreAfterMaxFailures.java:70)
>> >         at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
>> .java:48)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
>> run(ThreadLeakControl.java:358)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask
>> (ThreadLeakControl.java:782)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadL
>> eakControl.java:442)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran
>> domizedRunner.java:746)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Rando
>> mizedRunner.java:648)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Rando
>> mizedRunner.java:682)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Rando
>> mizedRunner.java:693)
>> >         at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
>> fterRule.java:46)
>> >         at
>> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreCl
>> assName.java:42)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
>> .evaluate(SystemPropertiesInvariantRule.java:55)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
>> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
>> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> >         at
>> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAss
>> ertionsRequired.java:43)
>> >         at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
>> .java:48)
>> >         at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
>> IgnoreAfterMaxFailures.java:70)
>> >         at
>> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnore
>> TestSuites.java:55)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
>> run(ThreadLeakControl.java:358)
>> >         at java.lang.Thread.run(Thread.java:780)
>> >
>> >
>> > REGRESSION:
>> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testTimedSearchT
>> ask
>> >
>> > Error Message:
>> >
>> >
>> > Stack Trace:
>> > java.lang.AssertionError
>> >         at
>> __randomizedtesting.SeedInfo.seed([900F08B0BE490539:652B526DF64A34D
>> 3]:0)
>> >         at
>> org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWr
>> iter.java:73)
>> >         at
>> org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
>> >         at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
>> >         at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
>> >         at
>> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.fi
>> nish(MemoryPostingsFormat.java:271)
>> >         at
>> org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTerm
>> sWriterPerField.java:553)
>> >         at
>> org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.j
>> ava:85)
>> >         at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
>> >         at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
>> >         at
>> org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
>> >         at
>> org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWrit
>> erPerThread.java:488)
>> >         at
>> org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:4
>> 22)
>> >         at
>> org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWrit
>> er.java:559)
>> >         at
>> org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
>> >         at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
>> >         at
>> org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1619)
>> >         at
>> org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1595)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.ForceMergeTask.doLogic(Force
>> MergeTask.java:41)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:143)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
>> kSequence.java:197)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
>> uence.java:138)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:143)
>> >         at
>> org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.jav
>> a:301)
>> >         at
>> org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:
>> 77)
>> >         at
>> org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(Bench
>> markTestCase.java:83)
>> >         at
>> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testTimedSearchT
>> ask(TestPerfTasksLogic.java:130)
>> >         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> >         at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
>> ava:88)
>> >         at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
>> sorImpl.java:55)
>> >         at java.lang.reflect.Method.invoke(Method.java:613)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize
>> dRunner.java:1559)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Rando
>> mizedRunner.java:79)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando
>> mizedRunner.java:737)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando
>> mizedRunner.java:773)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando
>> mizedRunner.java:787)
>> >         at
>> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule
>> SetupTeardownChained.java:50)
>> >         at
>> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCa
>> cheSanity.java:51)
>> >         at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
>> fterRule.java:46)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
>> .evaluate(SystemPropertiesInvariantRule.java:55)
>> >         at
>> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
>> readAndTestName.java:49)
>> >         at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
>> IgnoreAfterMaxFailures.java:70)
>> >         at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
>> .java:48)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
>> run(ThreadLeakControl.java:358)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask
>> (ThreadLeakControl.java:782)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadL
>> eakControl.java:442)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran
>> domizedRunner.java:746)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Rando
>> mizedRunner.java:648)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Rando
>> mizedRunner.java:682)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Rando
>> mizedRunner.java:693)
>> >         at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
>> fterRule.java:46)
>> >         at
>> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreCl
>> assName.java:42)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
>> .evaluate(SystemPropertiesInvariantRule.java:55)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
>> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
>> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> >         at
>> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAss
>> ertionsRequired.java:43)
>> >         at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
>> .java:48)
>> >         at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
>> IgnoreAfterMaxFailures.java:70)
>> >         at
>> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnore
>> TestSuites.java:55)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
>> run(ThreadLeakControl.java:358)
>> >         at java.lang.Thread.run(Thread.java:780)
>> >
>> >
>> > REGRESSION:
>> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testDisableCounti
>> ng
>> >
>> > Error Message:
>> >
>> >
>> > Stack Trace:
>> > java.lang.AssertionError
>> >         at
>> __randomizedtesting.SeedInfo.seed([900F08B0BE490539:907019F611C3328B
>> ]:0)
>> >         at
>> org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWr
>> iter.java:73)
>> >         at
>> org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
>> >         at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
>> >         at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
>> >         at
>> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.fi
>> nish(MemoryPostingsFormat.java:271)
>> >         at
>> org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTerm
>> sWriterPerField.java:553)
>> >         at
>> org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.j
>> ava:85)
>> >         at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
>> >         at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
>> >         at
>> org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
>> >         at
>> org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWrit
>> erPerThread.java:488)
>> >         at
>> org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:4
>> 22)
>> >         at
>> org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWrit
>> er.java:559)
>> >         at
>> org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
>> >         at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
>> >         at
>> org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:913)
>> >         at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:868)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.CloseIndexTask.doLogic(CloseIn
>> dexTask.java:48)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:143)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
>> kSequence.java:197)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
>> uence.java:138)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:143)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
>> kSequence.java:197)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
>> uence.java:138)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:143)
>> >         at
>> org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.jav
>> a:301)
>> >         at
>> org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:
>> 77)
>> >         at
>> org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(Bench
>> markTestCase.java:83)
>> >         at
>> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.doTestDisableCou
>> nting(TestPerfTasksLogic.java:860)
>> >         at
>> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testDisableCounti
>> ng(TestPerfTasksLogic.java:851)
>> >         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> >         at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
>> ava:88)
>> >         at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
>> sorImpl.java:55)
>> >         at java.lang.reflect.Method.invoke(Method.java:613)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize
>> dRunner.java:1559)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Rando
>> mizedRunner.java:79)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando
>> mizedRunner.java:737)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando
>> mizedRunner.java:773)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando
>> mizedRunner.java:787)
>> >         at
>> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule
>> SetupTeardownChained.java:50)
>> >         at
>> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCa
>> cheSanity.java:51)
>> >         at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
>> fterRule.java:46)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
>> .evaluate(SystemPropertiesInvariantRule.java:55)
>> >         at
>> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
>> readAndTestName.java:49)
>> >         at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
>> IgnoreAfterMaxFailures.java:70)
>> >         at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
>> .java:48)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
>> run(ThreadLeakControl.java:358)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask
>> (ThreadLeakControl.java:782)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadL
>> eakControl.java:442)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran
>> domizedRunner.java:746)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Rando
>> mizedRunner.java:648)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Rando
>> mizedRunner.java:682)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Rando
>> mizedRunner.java:693)
>> >         at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
>> fterRule.java:46)
>> >         at
>> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreCl
>> assName.java:42)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
>> .evaluate(SystemPropertiesInvariantRule.java:55)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
>> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
>> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> >         at
>> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAss
>> ertionsRequired.java:43)
>> >         at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
>> .java:48)
>> >         at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
>> IgnoreAfterMaxFailures.java:70)
>> >         at
>> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnore
>> TestSuites.java:55)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
>> run(ThreadLeakControl.java:358)
>> >         at java.lang.Thread.run(Thread.java:780)
>> >
>> >
>> > REGRESSION:
>> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testReadTokens
>> >
>> > Error Message:
>> >
>> >
>> > Stack Trace:
>> > java.lang.AssertionError
>> >         at
>> __randomizedtesting.SeedInfo.seed([900F08B0BE490539:47551770DF1E00E6
>> ]:0)
>> >         at
>> org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWr
>> iter.java:73)
>> >         at
>> org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
>> >         at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
>> >         at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
>> >         at
>> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.fi
>> nish(MemoryPostingsFormat.java:271)
>> >         at
>> org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTerm
>> sWriterPerField.java:553)
>> >         at
>> org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.j
>> ava:85)
>> >         at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
>> >         at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
>> >         at
>> org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
>> >         at
>> org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWrit
>> erPerThread.java:488)
>> >         at
>> org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:4
>> 22)
>> >         at
>> org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWrit
>> er.java:559)
>> >         at
>> org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
>> >         at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
>> >         at
>> org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:913)
>> >         at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:868)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.CloseIndexTask.doLogic(CloseIn
>> dexTask.java:48)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:143)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
>> kSequence.java:197)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
>> uence.java:138)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:143)
>> >         at
>> org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.jav
>> a:301)
>> >         at
>> org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:
>> 77)
>> >         at
>> org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(Bench
>> markTestCase.java:83)
>> >         at
>> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testReadTokens(T
>> estPerfTasksLogic.java:477)
>> >         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> >         at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
>> ava:88)
>> >         at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
>> sorImpl.java:55)
>> >         at java.lang.reflect.Method.invoke(Method.java:613)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize
>> dRunner.java:1559)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Rando
>> mizedRunner.java:79)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando
>> mizedRunner.java:737)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando
>> mizedRunner.java:773)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando
>> mizedRunner.java:787)
>> >         at
>> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule
>> SetupTeardownChained.java:50)
>> >         at
>> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCa
>> cheSanity.java:51)
>> >         at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
>> fterRule.java:46)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
>> .evaluate(SystemPropertiesInvariantRule.java:55)
>> >         at
>> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
>> readAndTestName.java:49)
>> >         at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
>> IgnoreAfterMaxFailures.java:70)
>> >         at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
>> .java:48)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
>> run(ThreadLeakControl.java:358)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask
>> (ThreadLeakControl.java:782)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadL
>> eakControl.java:442)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran
>> domizedRunner.java:746)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Rando
>> mizedRunner.java:648)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Rando
>> mizedRunner.java:682)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Rando
>> mizedRunner.java:693)
>> >         at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
>> fterRule.java:46)
>> >         at
>> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreCl
>> assName.java:42)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
>> .evaluate(SystemPropertiesInvariantRule.java:55)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
>> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
>> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> >         at
>> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAss
>> ertionsRequired.java:43)
>> >         at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
>> .java:48)
>> >         at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
>> IgnoreAfterMaxFailures.java:70)
>> >         at
>> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnore
>> TestSuites.java:55)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
>> run(ThreadLeakControl.java:358)
>> >         at java.lang.Thread.run(Thread.java:780)
>> >
>> >
>> > REGRESSION:
>> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testLineDocFile
>> >
>> > Error Message:
>> >
>> >
>> > Stack Trace:
>> > java.lang.AssertionError
>> >         at
>> __randomizedtesting.SeedInfo.seed([900F08B0BE490539:6698ED24DD4E654
>> A]:0)
>> >         at
>> org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWr
>> iter.java:73)
>> >         at
>> org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
>> >         at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
>> >         at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
>> >         at
>> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.fi
>> nish(MemoryPostingsFormat.java:271)
>> >         at
>> org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTerm
>> sWriterPerField.java:553)
>> >         at
>> org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.j
>> ava:85)
>> >         at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
>> >         at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
>> >         at
>> org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
>> >         at
>> org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWrit
>> erPerThread.java:488)
>> >         at
>> org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:4
>> 22)
>> >         at
>> org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWrit
>> er.java:559)
>> >         at
>> org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
>> >         at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
>> >         at
>> org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:913)
>> >         at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:868)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.CloseIndexTask.doLogic(CloseIn
>> dexTask.java:48)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:143)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
>> kSequence.java:197)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
>> uence.java:138)
>> >         at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:143)
>> >         at
>> org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.jav
>> a:301)
>> >         at
>> org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:
>> 77)
>> >         at
>> org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(Bench
>> markTestCase.java:83)
>> >         at
>> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testLineDocFile(Te
>> stPerfTasksLogic.java:438)
>> >         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> >         at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
>> ava:88)
>> >         at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
>> sorImpl.java:55)
>> >         at java.lang.reflect.Method.invoke(Method.java:613)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize
>> dRunner.java:1559)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Rando
>> mizedRunner.java:79)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando
>> mizedRunner.java:737)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando
>> mizedRunner.java:773)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando
>> mizedRunner.java:787)
>> >         at
>> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule
>> SetupTeardownChained.java:50)
>> >         at
>> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCa
>> cheSanity.java:51)
>> >         at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
>> fterRule.java:46)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
>> .evaluate(SystemPropertiesInvariantRule.java:55)
>> >         at
>> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
>> readAndTestName.java:49)
>> >         at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
>> IgnoreAfterMaxFailures.java:70)
>> >         at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
>> .java:48)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
>> run(ThreadLeakControl.java:358)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask
>> (ThreadLeakControl.java:782)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadL
>> eakControl.java:442)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran
>> domizedRunner.java:746)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Rando
>> mizedRunner.java:648)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Rando
>> mizedRunner.java:682)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Rando
>> mizedRunner.java:693)
>> >         at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
>> fterRule.java:46)
>> >         at
>> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreCl
>> assName.java:42)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
>> .evaluate(SystemPropertiesInvariantRule.java:55)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
>> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
>> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> >         at
>> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAss
>> ertionsRequired.java:43)
>> >         at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
>> .java:48)
>> >         at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
>> IgnoreAfterMaxFailures.java:70)
>> >         at
>> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnore
>> TestSuites.java:55)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
>> run(ThreadLeakControl.java:358)
>> >         at java.lang.Thread.run(Thread.java:780)
>> >
>> >
>> >
>> >
>> > Build Log:
>> > [...truncated 6122 lines...]
>> > [junit4:junit4] Suite:
>> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic
>> > [junit4:junit4]   1> ------------> starting task: Seq
>> > [junit4:junit4]   1> ------------> starting task: Seq
>> > [junit4:junit4]   1> ------------> starting task: Seq
>> > [junit4:junit4]   1> ------------> starting task: Seq
>> > [junit4:junit4]   2> NOTE: reproduce with: ant test  -
>> Dtestcase=TestPerfTasksLogic -Dtests.method=testBGSearchTaskThreads -
>> Dtests.seed=900F08B0BE490539 -Dtests.multiplier=3 -Dtests.slow=true -
>> Dtests.locale=sq_AL -Dtests.timezone=Europe/Luxembourg -
>> Dtests.file.encoding=ISO-8859-1
>> > [junit4:junit4] FAILURE 0.63s J0 |
>> TestPerfTasksLogic.testBGSearchTaskThreads <<<
>> > [junit4:junit4]    > Throwable #1: java.lang.AssertionError
>> > [junit4:junit4]    >    at
>> __randomizedtesting.SeedInfo.seed([900F08B0BE490539:4D3ACD6C068AD49
>> B]:0)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWr
>> iter.java:73)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
>> > [junit4:junit4]    >    at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.fi
>> nish(MemoryPostingsFormat.java:271)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTerm
>> sWriterPerField.java:553)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.j
>> ava:85)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWrit
>> erPerThread.java:488)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:4
>> 22)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWrit
>> er.java:559)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1619)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1595)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.ForceMergeTask.doLogic(Force
>> MergeTask.java:41)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:143)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
>> kSequence.java:197)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
>> uence.java:138)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:143)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.jav
>> a:301)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:
>> 77)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(Bench
>> markTestCase.java:83)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testBGSearchTask
>> Threads(TestPerfTasksLogic.java:157)
>> > [junit4:junit4]    >    at
>> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> > [junit4:junit4]    >    at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
>> ava:88)
>> > [junit4:junit4]    >    at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
>> sorImpl.java:55)
>> > [junit4:junit4]    >    at java.lang.reflect.Method.invoke(Method.java:613)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize
>> dRunner.java:1559)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Rando
>> mizedRunner.java:79)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando
>> mizedRunner.java:737)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando
>> mizedRunner.java:773)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando
>> mizedRunner.java:787)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule
>> SetupTeardownChained.java:50)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCa
>> cheSanity.java:51)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
>> fterRule.java:46)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
>> .evaluate(SystemPropertiesInvariantRule.java:55)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
>> readAndTestName.java:49)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
>> IgnoreAfterMaxFailures.java:70)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
>> .java:48)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
>> run(ThreadLeakControl.java:358)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask
>> (ThreadLeakControl.java:782)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadL
>> eakControl.java:442)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran
>> domizedRunner.java:746)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Rando
>> mizedRunner.java:648)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Rando
>> mizedRunner.java:682)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Rando
>> mizedRunner.java:693)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
>> fterRule.java:46)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreCl
>> assName.java:42)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
>> .evaluate(SystemPropertiesInvariantRule.java:55)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
>> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
>> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAss
>> ertionsRequired.java:43)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
>> .java:48)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
>> IgnoreAfterMaxFailures.java:70)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnore
>> TestSuites.java:55)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
>> run(ThreadLeakControl.java:358)
>> > [junit4:junit4]    >    at java.lang.Thread.run(Thread.java:780)
>> > [junit4:junit4]   1> ------------> starting task: Seq
>> > [junit4:junit4]   2> NOTE: reproduce with: ant test  -
>> Dtestcase=TestPerfTasksLogic -Dtests.method=testExhaustContentSource -
>> Dtests.seed=900F08B0BE490539 -Dtests.multiplier=3 -Dtests.slow=true -
>> Dtests.locale=sq_AL -Dtests.timezone=Europe/Luxembourg -
>> Dtests.file.encoding=ISO-8859-1
>> > [junit4:junit4] FAILURE 0.05s J0 |
>> TestPerfTasksLogic.testExhaustContentSource <<<
>> > [junit4:junit4]    > Throwable #1: java.lang.AssertionError
>> > [junit4:junit4]    >    at
>> __randomizedtesting.SeedInfo.seed([900F08B0BE490539:28FE72D1146C5FA0
>> ]:0)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWr
>> iter.java:73)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
>> > [junit4:junit4]    >    at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.fi
>> nish(MemoryPostingsFormat.java:271)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTerm
>> sWriterPerField.java:553)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.j
>> ava:85)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWrit
>> erPerThread.java:488)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:4
>> 22)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWrit
>> er.java:559)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1619)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1595)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.ForceMergeTask.doLogic(Force
>> MergeTask.java:41)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:143)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
>> kSequence.java:197)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
>> uence.java:138)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:143)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.jav
>> a:301)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:
>> 77)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(Bench
>> markTestCase.java:83)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testExhaustConte
>> ntSource(TestPerfTasksLogic.java:304)
>> > [junit4:junit4]    >    at
>> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> > [junit4:junit4]    >    at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
>> ava:88)
>> > [junit4:junit4]    >    at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
>> sorImpl.java:55)
>> > [junit4:junit4]    >    at java.lang.reflect.Method.invoke(Method.java:613)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize
>> dRunner.java:1559)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Rando
>> mizedRunner.java:79)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando
>> mizedRunner.java:737)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando
>> mizedRunner.java:773)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando
>> mizedRunner.java:787)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule
>> SetupTeardownChained.java:50)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCa
>> cheSanity.java:51)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
>> fterRule.java:46)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
>> .evaluate(SystemPropertiesInvariantRule.java:55)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
>> readAndTestName.java:49)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
>> IgnoreAfterMaxFailures.java:70)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
>> .java:48)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
>> run(ThreadLeakControl.java:358)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask
>> (ThreadLeakControl.java:782)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadL
>> eakControl.java:442)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran
>> domizedRunner.java:746)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Rando
>> mizedRunner.java:648)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Rando
>> mizedRunner.java:682)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Rando
>> mizedRunner.java:693)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
>> fterRule.java:46)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreCl
>> assName.java:42)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
>> .evaluate(SystemPropertiesInvariantRule.java:55)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
>> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
>> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAss
>> ertionsRequired.java:43)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
>> .java:48)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
>> IgnoreAfterMaxFailures.java:70)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnore
>> TestSuites.java:55)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
>> run(ThreadLeakControl.java:358)
>> > [junit4:junit4]    >    at java.lang.Thread.run(Thread.java:780)
>> > [junit4:junit4]   1> Changed Locale to: null
>> > [junit4:junit4]   1>
>> > [junit4:junit4]   1> --> Round 0-->1
>> > [junit4:junit4]   1>
>> > [junit4:junit4]   1> Changed Locale to: root locale
>> > [junit4:junit4]   1>
>> > [junit4:junit4]   1> --> Round 0-->1
>> > [junit4:junit4]   1>
>> > [junit4:junit4]   1> Changed Locale to: de
>> > [junit4:junit4]   1>
>> > [junit4:junit4]   1> --> Round 0-->1
>> > [junit4:junit4]   1>
>> > [junit4:junit4]   1> Changed Locale to: en_US
>> > [junit4:junit4]   1>
>> > [junit4:junit4]   1> --> Round 0-->1
>> > [junit4:junit4]   1>
>> > [junit4:junit4]   1> Changed Locale to: no_NO_NY
>> > [junit4:junit4]   1>
>> > [junit4:junit4]   1> --> Round 0-->1
>> > [junit4:junit4]   1>
>> > [junit4:junit4]   1> ------------> starting task: Rounds_2
>> > [junit4:junit4]   2> NOTE: reproduce with: ant test  -
>> Dtestcase=TestPerfTasksLogic -Dtests.method=testExhaustedLooped -
>> Dtests.seed=900F08B0BE490539 -Dtests.multiplier=3 -Dtests.slow=true -
>> Dtests.locale=sq_AL -Dtests.timezone=Europe/Luxembourg -
>> Dtests.file.encoding=ISO-8859-1
>> > [junit4:junit4] FAILURE 0.06s J0 | TestPerfTasksLogic.testExhaustedLooped
>> <<<
>> > [junit4:junit4]    > Throwable #1: java.lang.AssertionError
>> > [junit4:junit4]    >    at
>> __randomizedtesting.SeedInfo.seed([900F08B0BE490539:1AE3BB949772D23
>> F]:0)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWr
>> iter.java:73)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
>> > [junit4:junit4]    >    at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.fi
>> nish(MemoryPostingsFormat.java:271)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTerm
>> sWriterPerField.java:553)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.j
>> ava:85)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWrit
>> erPerThread.java:488)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:4
>> 22)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWrit
>> er.java:559)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:913)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.IndexWriter.close(IndexWriter.java:868)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.CloseIndexTask.doLogic(CloseIn
>> dexTask.java:48)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:143)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
>> kSequence.java:197)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
>> uence.java:138)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:143)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.jav
>> a:301)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:
>> 77)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(Bench
>> markTestCase.java:83)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testExhaustedLoo
>> ped(TestPerfTasksLogic.java:583)
>> > [junit4:junit4]    >    at
>> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> > [junit4:junit4]    >    at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
>> ava:88)
>> > [junit4:junit4]    >    at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
>> sorImpl.java:55)
>> > [junit4:junit4]    >    at java.lang.reflect.Method.invoke(Method.java:613)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize
>> dRunner.java:1559)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Rando
>> mizedRunner.java:79)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando
>> mizedRunner.java:737)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando
>> mizedRunner.java:773)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando
>> mizedRunner.java:787)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule
>> SetupTeardownChained.java:50)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCa
>> cheSanity.java:51)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
>> fterRule.java:46)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
>> .evaluate(SystemPropertiesInvariantRule.java:55)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
>> readAndTestName.java:49)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
>> IgnoreAfterMaxFailures.java:70)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
>> .java:48)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
>> run(ThreadLeakControl.java:358)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask
>> (ThreadLeakControl.java:782)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadL
>> eakControl.java:442)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran
>> domizedRunner.java:746)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Rando
>> mizedRunner.java:648)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Rando
>> mizedRunner.java:682)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Rando
>> mizedRunner.java:693)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
>> fterRule.java:46)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreCl
>> assName.java:42)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
>> .evaluate(SystemPropertiesInvariantRule.java:55)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
>> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
>> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAss
>> ertionsRequired.java:43)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
>> .java:48)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
>> IgnoreAfterMaxFailures.java:70)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnore
>> TestSuites.java:55)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
>> run(ThreadLeakControl.java:358)
>> > [junit4:junit4]    >    at java.lang.Thread.run(Thread.java:780)
>> > [junit4:junit4]   1> ------------> starting task: Seq
>> > [junit4:junit4]   1> Changed Analyzer to: ShingleAnalyzerWrapper, wrapping
>> ShingleFilter over org.apache.lucene.analysis.standard.StandardAnalyzer
>> > [junit4:junit4]   1> ------------> starting task: Seq
>> > [junit4:junit4]   1> Changed Analyzer to: ShingleAnalyzerWrapper, wrapping
>> ShingleFilter over org.apache.lucene.analysis.standard.StandardAnalyzer
>> > [junit4:junit4]   1> ------------> starting task: Seq
>> > [junit4:junit4]   1> Changed Analyzer to: ShingleAnalyzerWrapper, wrapping
>> ShingleFilter over org.apache.lucene.analysis.core.WhitespaceAnalyzer
>> > [junit4:junit4]   1> ------------> starting task: Seq
>> > [junit4:junit4]   1> Changed Analyzer to: ShingleAnalyzerWrapper, wrapping
>> ShingleFilter over org.apache.lucene.analysis.core.WhitespaceAnalyzer
>> > [junit4:junit4]   1> ------------> starting task: Seq
>> > [junit4:junit4]   1>    0.16 sec --> TEST-
>> TestPerfTasksLogic.testIndexAndSearchTasks-seed#[900F08B0BE490539]
>> added      1000 docs
>> > [junit4:junit4]   2> NOTE: reproduce with: ant test  -
>> Dtestcase=TestPerfTasksLogic -Dtests.method=testIndexAndSearchTasks -
>> Dtests.seed=900F08B0BE490539 -Dtests.multiplier=3 -Dtests.slow=true -
>> Dtests.locale=sq_AL -Dtests.timezone=Europe/Luxembourg -
>> Dtests.file.encoding=ISO-8859-1
>> > [junit4:junit4] FAILURE 0.25s J0 |
>> TestPerfTasksLogic.testIndexAndSearchTasks <<<
>> > [junit4:junit4]    > Throwable #1: java.lang.AssertionError
>> > [junit4:junit4]    >    at
>> __randomizedtesting.SeedInfo.seed([900F08B0BE490539:E3C813A59FA3EB2
>> 1]:0)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWr
>> iter.java:73)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
>> > [junit4:junit4]    >    at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.fi
>> nish(MemoryPostingsFormat.java:271)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTerm
>> sWriterPerField.java:553)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.j
>> ava:85)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWrit
>> erPerThread.java:488)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:4
>> 22)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWrit
>> er.java:559)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1619)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1595)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.ForceMergeTask.doLogic(Force
>> MergeTask.java:41)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:143)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
>> kSequence.java:197)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
>> uence.java:138)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:143)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.jav
>> a:301)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:
>> 77)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(Bench
>> markTestCase.java:83)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testIndexAndSear
>> chTasks(TestPerfTasksLogic.java:98)
>> > [junit4:junit4]    >    at
>> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> > [junit4:junit4]    >    at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
>> ava:88)
>> > [junit4:junit4]    >    at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
>> sorImpl.java:55)
>> > [junit4:junit4]    >    at java.lang.reflect.Method.invoke(Method.java:613)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize
>> dRunner.java:1559)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Rando
>> mizedRunner.java:79)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando
>> mizedRunner.java:737)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando
>> mizedRunner.java:773)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando
>> mizedRunner.java:787)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule
>> SetupTeardownChained.java:50)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCa
>> cheSanity.java:51)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
>> fterRule.java:46)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
>> .evaluate(SystemPropertiesInvariantRule.java:55)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
>> readAndTestName.java:49)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
>> IgnoreAfterMaxFailures.java:70)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
>> .java:48)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
>> run(ThreadLeakControl.java:358)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask
>> (ThreadLeakControl.java:782)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadL
>> eakControl.java:442)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran
>> domizedRunner.java:746)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Rando
>> mizedRunner.java:648)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Rando
>> mizedRunner.java:682)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Rando
>> mizedRunner.java:693)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
>> fterRule.java:46)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreCl
>> assName.java:42)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
>> .evaluate(SystemPropertiesInvariantRule.java:55)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
>> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
>> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAss
>> ertionsRequired.java:43)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
>> .java:48)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
>> IgnoreAfterMaxFailures.java:70)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnore
>> TestSuites.java:55)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
>> run(ThreadLeakControl.java:358)
>> > [junit4:junit4]    >    at java.lang.Thread.run(Thread.java:780)
>> > [junit4:junit4]   2> NOTE: reproduce with: ant test  -
>> Dtestcase=TestPerfTasksLogic -Dtests.method=testCloseIndexFalse -
>> Dtests.seed=900F08B0BE490539 -Dtests.multiplier=3 -Dtests.slow=true -
>> Dtests.locale=sq_AL -Dtests.timezone=Europe/Luxembourg -
>> Dtests.file.encoding=ISO-8859-1
>> > [junit4:junit4] FAILURE 0.07s J0 | TestPerfTasksLogic.testCloseIndexFalse
>> <<<
>> > [junit4:junit4]    > Throwable #1: java.lang.AssertionError
>> > [junit4:junit4]    >    at
>> __randomizedtesting.SeedInfo.seed([900F08B0BE490539:66537D56A7655F69
>> ]:0)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWr
>> iter.java:73)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
>> > [junit4:junit4]    >    at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.fi
>> nish(MemoryPostingsFormat.java:271)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTerm
>> sWriterPerField.java:553)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.j
>> ava:85)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWrit
>> erPerThread.java:488)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:4
>> 22)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocumentsWriter.postUpdate(DocumentsWriter.ja
>> va:316)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWr
>> iter.java:389)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:14
>> 58)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1133)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1114)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.AddDocTask.doLogic(AddDocTas
>> k.java:70)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:132)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
>> kSequence.java:197)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
>> uence.java:138)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:143)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
>> kSequence.java:197)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
>> uence.java:138)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:143)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.jav
>> a:301)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:
>> 77)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(Bench
>> markTestCase.java:83)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testCloseIndexFals
>> e(TestPerfTasksLogic.java:620)
>> > [junit4:junit4]    >    at
>> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> > [junit4:junit4]    >    at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
>> ava:88)
>> > [junit4:junit4]    >    at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
>> sorImpl.java:55)
>> > [junit4:junit4]    >    at java.lang.reflect.Method.invoke(Method.java:613)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize
>> dRunner.java:1559)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Rando
>> mizedRunner.java:79)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando
>> mizedRunner.java:737)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando
>> mizedRunner.java:773)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando
>> mizedRunner.java:787)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule
>> SetupTeardownChained.java:50)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCa
>> cheSanity.java:51)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
>> fterRule.java:46)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
>> .evaluate(SystemPropertiesInvariantRule.java:55)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
>> readAndTestName.java:49)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
>> IgnoreAfterMaxFailures.java:70)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
>> .java:48)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
>> run(ThreadLeakControl.java:358)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask
>> (ThreadLeakControl.java:782)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadL
>> eakControl.java:442)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran
>> domizedRunner.java:746)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Rando
>> mizedRunner.java:648)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Rando
>> mizedRunner.java:682)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Rando
>> mizedRunner.java:693)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
>> fterRule.java:46)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreCl
>> assName.java:42)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
>> .evaluate(SystemPropertiesInvariantRule.java:55)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
>> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
>> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAss
>> ertionsRequired.java:43)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
>> .java:48)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
>> IgnoreAfterMaxFailures.java:70)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnore
>> TestSuites.java:55)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
>> run(ThreadLeakControl.java:358)
>> > [junit4:junit4]    >    at java.lang.Thread.run(Thread.java:780)
>> > [junit4:junit4]   1> ------------> starting task: Seq
>> > [junit4:junit4]   1>    0.69 sec --> TEST-
>> TestPerfTasksLogic.testHighlightingTV-seed#[900F08B0BE490539] added
>> 1000 docs
>> > [junit4:junit4]   2> NOTE: reproduce with: ant test  -
>> Dtestcase=TestPerfTasksLogic -Dtests.method=testHighlightingTV -
>> Dtests.seed=900F08B0BE490539 -Dtests.multiplier=3 -Dtests.slow=true -
>> Dtests.locale=sq_AL -Dtests.timezone=Europe/Luxembourg -
>> Dtests.file.encoding=ISO-8859-1
>> > [junit4:junit4] FAILURE 0.89s J0 | TestPerfTasksLogic.testHighlightingTV <<<
>> > [junit4:junit4]    > Throwable #1: java.lang.AssertionError
>> > [junit4:junit4]    >    at
>> __randomizedtesting.SeedInfo.seed([900F08B0BE490539:F02D2EC62156EDA
>> 0]:0)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWr
>> iter.java:73)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
>> > [junit4:junit4]    >    at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.fi
>> nish(MemoryPostingsFormat.java:271)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTerm
>> sWriterPerField.java:553)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.j
>> ava:85)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWrit
>> erPerThread.java:488)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:4
>> 22)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWrit
>> er.java:559)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1619)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1595)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.ForceMergeTask.doLogic(Force
>> MergeTask.java:41)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:143)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
>> kSequence.java:197)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
>> uence.java:138)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:143)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.jav
>> a:301)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:
>> 77)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(Bench
>> markTestCase.java:83)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testHighlightingTV
>> (TestPerfTasksLogic.java:227)
>> > [junit4:junit4]    >    at
>> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> > [junit4:junit4]    >    at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
>> ava:88)
>> > [junit4:junit4]    >    at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
>> sorImpl.java:55)
>> > [junit4:junit4]    >    at java.lang.reflect.Method.invoke(Method.java:613)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize
>> dRunner.java:1559)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Rando
>> mizedRunner.java:79)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando
>> mizedRunner.java:737)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando
>> mizedRunner.java:773)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando
>> mizedRunner.java:787)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule
>> SetupTeardownChained.java:50)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCa
>> cheSanity.java:51)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
>> fterRule.java:46)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
>> .evaluate(SystemPropertiesInvariantRule.java:55)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
>> readAndTestName.java:49)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
>> IgnoreAfterMaxFailures.java:70)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
>> .java:48)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
>> run(ThreadLeakControl.java:358)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask
>> (ThreadLeakControl.java:782)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadL
>> eakControl.java:442)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran
>> domizedRunner.java:746)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Rando
>> mizedRunner.java:648)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Rando
>> mizedRunner.java:682)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Rando
>> mizedRunner.java:693)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
>> fterRule.java:46)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreCl
>> assName.java:42)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
>> .evaluate(SystemPropertiesInvariantRule.java:55)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
>> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
>> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAss
>> ertionsRequired.java:43)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
>> .java:48)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
>> IgnoreAfterMaxFailures.java:70)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnore
>> TestSuites.java:55)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
>> run(ThreadLeakControl.java:358)
>> > [junit4:junit4]    >    at java.lang.Thread.run(Thread.java:780)
>> > [junit4:junit4]   1> ------------> starting task: Seq
>> > [junit4:junit4]   1> ------------> starting task: CreateIndex
>> > [junit4:junit4]   1> ------------> starting task: Seq_Exhaust
>> > [junit4:junit4]   1> ------------> starting task: Seq_Exhaust
>> > [junit4:junit4]   1> ------------> starting task: WaitForMerges
>> > [junit4:junit4]   1> ------------> starting task: CloseIndex
>> > [junit4:junit4]   2> NOTE: reproduce with: ant test  -
>> Dtestcase=TestPerfTasksLogic -Dtests.method=testParallelExhausted -
>> Dtests.seed=900F08B0BE490539 -Dtests.multiplier=3 -Dtests.slow=true -
>> Dtests.locale=sq_AL -Dtests.timezone=Europe/Luxembourg -
>> Dtests.file.encoding=ISO-8859-1
>> > [junit4:junit4] FAILURE 0.10s J0 | TestPerfTasksLogic.testParallelExhausted
>> <<<
>> > [junit4:junit4]    > Throwable #1: java.lang.AssertionError
>> > [junit4:junit4]    >    at
>> __randomizedtesting.SeedInfo.seed([900F08B0BE490539:D1A71DF46B96804
>> 5]:0)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWr
>> iter.java:73)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
>> > [junit4:junit4]    >    at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.fi
>> nish(MemoryPostingsFormat.java:271)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTerm
>> sWriterPerField.java:553)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.j
>> ava:85)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWrit
>> erPerThread.java:488)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:4
>> 22)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWrit
>> er.java:559)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:913)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.IndexWriter.close(IndexWriter.java:868)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.CloseIndexTask.doLogic(CloseIn
>> dexTask.java:48)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:143)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
>> kSequence.java:197)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
>> uence.java:138)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:143)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.jav
>> a:301)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:
>> 77)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(Bench
>> markTestCase.java:83)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testParallelExhaus
>> ted(TestPerfTasksLogic.java:546)
>> > [junit4:junit4]    >    at
>> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> > [junit4:junit4]    >    at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
>> ava:88)
>> > [junit4:junit4]    >    at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
>> sorImpl.java:55)
>> > [junit4:junit4]    >    at java.lang.reflect.Method.invoke(Method.java:613)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize
>> dRunner.java:1559)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Rando
>> mizedRunner.java:79)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando
>> mizedRunner.java:737)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando
>> mizedRunner.java:773)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando
>> mizedRunner.java:787)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule
>> SetupTeardownChained.java:50)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCa
>> cheSanity.java:51)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
>> fterRule.java:46)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
>> .evaluate(SystemPropertiesInvariantRule.java:55)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
>> readAndTestName.java:49)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
>> IgnoreAfterMaxFailures.java:70)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
>> .java:48)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
>> run(ThreadLeakControl.java:358)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask
>> (ThreadLeakControl.java:782)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadL
>> eakControl.java:442)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran
>> domizedRunner.java:746)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Rando
>> mizedRunner.java:648)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Rando
>> mizedRunner.java:682)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Rando
>> mizedRunner.java:693)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
>> fterRule.java:46)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreCl
>> assName.java:42)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
>> .evaluate(SystemPropertiesInvariantRule.java:55)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
>> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
>> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAss
>> ertionsRequired.java:43)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
>> .java:48)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
>> IgnoreAfterMaxFailures.java:70)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnore
>> TestSuites.java:55)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
>> run(ThreadLeakControl.java:358)
>> > [junit4:junit4]    >    at java.lang.Thread.run(Thread.java:780)
>> > [junit4:junit4]   1> ------------> starting task: Seq
>> > [junit4:junit4]   1>    0.22 sec --> TEST-
>> TestPerfTasksLogic.testHighlightingNoTvNoStore-seed#[900F08B0BE490539]
>> added      1000 docs
>> > [junit4:junit4]   2> NOTE: reproduce with: ant test  -
>> Dtestcase=TestPerfTasksLogic -Dtests.method=testHighlightingNoTvNoStore
>> -Dtests.seed=900F08B0BE490539 -Dtests.multiplier=3 -Dtests.slow=true -
>> Dtests.locale=sq_AL -Dtests.timezone=Europe/Luxembourg -
>> Dtests.file.encoding=ISO-8859-1
>> > [junit4:junit4] FAILURE 0.32s J0 |
>> TestPerfTasksLogic.testHighlightingNoTvNoStore <<<
>> > [junit4:junit4]    > Throwable #1: java.lang.AssertionError
>> > [junit4:junit4]    >    at
>> __randomizedtesting.SeedInfo.seed([900F08B0BE490539:2B1EF047A6586966
>> ]:0)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWr
>> iter.java:73)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
>> > [junit4:junit4]    >    at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.fi
>> nish(MemoryPostingsFormat.java:271)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTerm
>> sWriterPerField.java:553)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.j
>> ava:85)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWrit
>> erPerThread.java:488)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:4
>> 22)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWrit
>> er.java:559)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1619)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1595)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.ForceMergeTask.doLogic(Force
>> MergeTask.java:41)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:143)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
>> kSequence.java:197)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
>> uence.java:138)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:143)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.jav
>> a:301)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:
>> 77)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(Bench
>> markTestCase.java:83)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testHighlightingNo
>> TvNoStore(TestPerfTasksLogic.java:266)
>> > [junit4:junit4]    >    at
>> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> > [junit4:junit4]    >    at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
>> ava:88)
>> > [junit4:junit4]    >    at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
>> sorImpl.java:55)
>> > [junit4:junit4]    >    at java.lang.reflect.Method.invoke(Method.java:613)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize
>> dRunner.java:1559)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Rando
>> mizedRunner.java:79)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando
>> mizedRunner.java:737)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando
>> mizedRunner.java:773)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando
>> mizedRunner.java:787)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule
>> SetupTeardownChained.java:50)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCa
>> cheSanity.java:51)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
>> fterRule.java:46)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
>> .evaluate(SystemPropertiesInvariantRule.java:55)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
>> readAndTestName.java:49)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
>> IgnoreAfterMaxFailures.java:70)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
>> .java:48)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
>> run(ThreadLeakControl.java:358)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask
>> (ThreadLeakControl.java:782)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadL
>> eakControl.java:442)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran
>> domizedRunner.java:746)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Rando
>> mizedRunner.java:648)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Rando
>> mizedRunner.java:682)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Rando
>> mizedRunner.java:693)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
>> fterRule.java:46)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreCl
>> assName.java:42)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
>> .evaluate(SystemPropertiesInvariantRule.java:55)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
>> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
>> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAss
>> ertionsRequired.java:43)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
>> .java:48)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
>> IgnoreAfterMaxFailures.java:70)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnore
>> TestSuites.java:55)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
>> run(ThreadLeakControl.java:358)
>> > [junit4:junit4]    >    at java.lang.Thread.run(Thread.java:780)
>> > [junit4:junit4]   2> NOTE: reproduce with: ant test  -
>> Dtestcase=TestPerfTasksLogic -Dtests.method=testIndexWriterSettings -
>> Dtests.seed=900F08B0BE490539 -Dtests.multiplier=3 -Dtests.slow=true -
>> Dtests.locale=sq_AL -Dtests.timezone=Europe/Luxembourg -
>> Dtests.file.encoding=ISO-8859-1
>> > [junit4:junit4] FAILURE 0.04s J0 |
>> TestPerfTasksLogic.testIndexWriterSettings <<<
>> > [junit4:junit4]    > Throwable #1: java.lang.AssertionError
>> > [junit4:junit4]    >    at
>> __randomizedtesting.SeedInfo.seed([900F08B0BE490539:A8E67B1D32305055
>> ]:0)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWr
>> iter.java:73)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
>> > [junit4:junit4]    >    at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.fi
>> nish(MemoryPostingsFormat.java:271)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTerm
>> sWriterPerField.java:553)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.j
>> ava:85)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWrit
>> erPerThread.java:488)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:4
>> 22)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocumentsWriter.postUpdate(DocumentsWriter.ja
>> va:316)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWr
>> iter.java:389)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:14
>> 58)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1133)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1114)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.AddDocTask.doLogic(AddDocTas
>> k.java:70)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:132)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
>> kSequence.java:197)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
>> uence.java:138)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:143)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
>> kSequence.java:197)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
>> uence.java:138)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:143)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.jav
>> a:301)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:
>> 77)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(Bench
>> markTestCase.java:83)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testIndexWriterSe
>> ttings(TestPerfTasksLogic.java:752)
>> > [junit4:junit4]    >    at
>> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> > [junit4:junit4]    >    at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
>> ava:88)
>> > [junit4:junit4]    >    at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
>> sorImpl.java:55)
>> > [junit4:junit4]    >    at java.lang.reflect.Method.invoke(Method.java:613)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize
>> dRunner.java:1559)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Rando
>> mizedRunner.java:79)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando
>> mizedRunner.java:737)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando
>> mizedRunner.java:773)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando
>> mizedRunner.java:787)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule
>> SetupTeardownChained.java:50)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCa
>> cheSanity.java:51)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
>> fterRule.java:46)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
>> .evaluate(SystemPropertiesInvariantRule.java:55)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
>> readAndTestName.java:49)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
>> IgnoreAfterMaxFailures.java:70)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
>> .java:48)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
>> run(ThreadLeakControl.java:358)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask
>> (ThreadLeakControl.java:782)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadL
>> eakControl.java:442)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran
>> domizedRunner.java:746)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Rando
>> mizedRunner.java:648)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Rando
>> mizedRunner.java:682)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Rando
>> mizedRunner.java:693)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
>> fterRule.java:46)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreCl
>> assName.java:42)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
>> .evaluate(SystemPropertiesInvariantRule.java:55)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
>> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
>> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAss
>> ertionsRequired.java:43)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
>> .java:48)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
>> IgnoreAfterMaxFailures.java:70)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnore
>> TestSuites.java:55)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
>> run(ThreadLeakControl.java:358)
>> > [junit4:junit4]    >    at java.lang.Thread.run(Thread.java:780)
>> > [junit4:junit4]   1> ------------> starting task: Seq
>> > [junit4:junit4]   2> NOTE: reproduce with: ant test  -
>> Dtestcase=TestPerfTasksLogic -Dtests.method=testIndexingWithFacets -
>> Dtests.seed=900F08B0BE490539 -Dtests.multiplier=3 -Dtests.slow=true -
>> Dtests.locale=sq_AL -Dtests.timezone=Europe/Luxembourg -
>> Dtests.file.encoding=ISO-8859-1
>> > [junit4:junit4] FAILURE 0.71s J0 |
>> TestPerfTasksLogic.testIndexingWithFacets <<<
>> > [junit4:junit4]    > Throwable #1: java.lang.AssertionError
>> > [junit4:junit4]    >    at
>> __randomizedtesting.SeedInfo.seed([900F08B0BE490539:B1ADCFFDAC233B
>> D9]:0)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWr
>> iter.java:73)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
>> > [junit4:junit4]    >    at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.fi
>> nish(MemoryPostingsFormat.java:271)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTerm
>> sWriterPerField.java:553)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.j
>> ava:85)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWrit
>> erPerThread.java:488)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:4
>> 22)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWrit
>> er.java:559)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:913)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.IndexWriter.close(IndexWriter.java:868)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.CloseIndexTask.doLogic(CloseIn
>> dexTask.java:48)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:143)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
>> kSequence.java:197)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
>> uence.java:138)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:143)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.jav
>> a:301)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:
>> 77)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(Bench
>> markTestCase.java:83)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testIndexingWithF
>> acets(TestPerfTasksLogic.java:794)
>> > [junit4:junit4]    >    at
>> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> > [junit4:junit4]    >    at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
>> ava:88)
>> > [junit4:junit4]    >    at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
>> sorImpl.java:55)
>> > [junit4:junit4]    >    at java.lang.reflect.Method.invoke(Method.java:613)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize
>> dRunner.java:1559)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Rando
>> mizedRunner.java:79)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando
>> mizedRunner.java:737)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando
>> mizedRunner.java:773)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando
>> mizedRunner.java:787)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule
>> SetupTeardownChained.java:50)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCa
>> cheSanity.java:51)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
>> fterRule.java:46)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
>> .evaluate(SystemPropertiesInvariantRule.java:55)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
>> readAndTestName.java:49)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
>> IgnoreAfterMaxFailures.java:70)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
>> .java:48)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
>> run(ThreadLeakControl.java:358)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask
>> (ThreadLeakControl.java:782)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadL
>> eakControl.java:442)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran
>> domizedRunner.java:746)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Rando
>> mizedRunner.java:648)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Rando
>> mizedRunner.java:682)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Rando
>> mizedRunner.java:693)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
>> fterRule.java:46)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreCl
>> assName.java:42)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
>> .evaluate(SystemPropertiesInvariantRule.java:55)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
>> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
>> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAss
>> ertionsRequired.java:43)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
>> .java:48)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
>> IgnoreAfterMaxFailures.java:70)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnore
>> TestSuites.java:55)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
>> run(ThreadLeakControl.java:358)
>> > [junit4:junit4]    >    at java.lang.Thread.run(Thread.java:780)
>> > [junit4:junit4]   1> ------------> starting task: Seq
>> > [junit4:junit4]   2> NOTE: reproduce with: ant test  -
>> Dtestcase=TestPerfTasksLogic -Dtests.method=testTimedSearchTask -
>> Dtests.seed=900F08B0BE490539 -Dtests.multiplier=3 -Dtests.slow=true -
>> Dtests.locale=sq_AL -Dtests.timezone=Europe/Luxembourg -
>> Dtests.file.encoding=ISO-8859-1
>> > [junit4:junit4] FAILURE 0.07s J0 | TestPerfTasksLogic.testTimedSearchTask
>> <<<
>> > [junit4:junit4]    > Throwable #1: java.lang.AssertionError
>> > [junit4:junit4]    >    at
>> __randomizedtesting.SeedInfo.seed([900F08B0BE490539:652B526DF64A34D
>> 3]:0)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWr
>> iter.java:73)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
>> > [junit4:junit4]    >    at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.fi
>> nish(MemoryPostingsFormat.java:271)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTerm
>> sWriterPerField.java:553)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.j
>> ava:85)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWrit
>> erPerThread.java:488)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:4
>> 22)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWrit
>> er.java:559)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1619)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1595)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.ForceMergeTask.doLogic(Force
>> MergeTask.java:41)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:143)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
>> kSequence.java:197)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
>> uence.java:138)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:143)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.jav
>> a:301)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:
>> 77)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(Bench
>> markTestCase.java:83)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testTimedSearchT
>> ask(TestPerfTasksLogic.java:130)
>> > [junit4:junit4]    >    at
>> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> > [junit4:junit4]    >    at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
>> ava:88)
>> > [junit4:junit4]    >    at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
>> sorImpl.java:55)
>> > [junit4:junit4]    >    at java.lang.reflect.Method.invoke(Method.java:613)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize
>> dRunner.java:1559)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Rando
>> mizedRunner.java:79)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando
>> mizedRunner.java:737)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando
>> mizedRunner.java:773)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando
>> mizedRunner.java:787)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule
>> SetupTeardownChained.java:50)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCa
>> cheSanity.java:51)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
>> fterRule.java:46)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
>> .evaluate(SystemPropertiesInvariantRule.java:55)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
>> readAndTestName.java:49)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
>> IgnoreAfterMaxFailures.java:70)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
>> .java:48)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
>> run(ThreadLeakControl.java:358)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask
>> (ThreadLeakControl.java:782)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadL
>> eakControl.java:442)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran
>> domizedRunner.java:746)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Rando
>> mizedRunner.java:648)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Rando
>> mizedRunner.java:682)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Rando
>> mizedRunner.java:693)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
>> fterRule.java:46)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreCl
>> assName.java:42)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
>> .evaluate(SystemPropertiesInvariantRule.java:55)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
>> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
>> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAss
>> ertionsRequired.java:43)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
>> .java:48)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
>> IgnoreAfterMaxFailures.java:70)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnore
>> TestSuites.java:55)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
>> run(ThreadLeakControl.java:358)
>> > [junit4:junit4]    >    at java.lang.Thread.run(Thread.java:780)
>> > [junit4:junit4]   1> Changed Locale to: root locale
>> > [junit4:junit4]   1> Changed Analyzer to:
>> org.apache.lucene.collation.CollationKeyAnalyzer()
>> > [junit4:junit4]   1>
>> > [junit4:junit4]   1> --> Round 0-->1
>> > [junit4:junit4]   1>
>> > [junit4:junit4]   1> Changed Locale to: de
>> > [junit4:junit4]   1> Changed Analyzer to:
>> org.apache.lucene.collation.CollationKeyAnalyzer(de)
>> > [junit4:junit4]   1>
>> > [junit4:junit4]   1> --> Round 0-->1
>> > [junit4:junit4]   1>
>> > [junit4:junit4]   1> Changed Locale to: en_US
>> > [junit4:junit4]   1> Changed Analyzer to:
>> org.apache.lucene.collation.CollationKeyAnalyzer(en_US)
>> > [junit4:junit4]   1>
>> > [junit4:junit4]   1> --> Round 0-->1
>> > [junit4:junit4]   1>
>> > [junit4:junit4]   1> Changed Locale to: no_NO_NY
>> > [junit4:junit4]   1> Changed Analyzer to:
>> org.apache.lucene.collation.CollationKeyAnalyzer(no_NO_NY)
>> > [junit4:junit4]   1>
>> > [junit4:junit4]   1> --> Round 0-->1
>> > [junit4:junit4]   1>
>> > [junit4:junit4]   1> ------------> starting task: Seq
>> > [junit4:junit4]   1> ------------> starting task: Rounds
>> > [junit4:junit4]   2> NOTE: reproduce with: ant test  -
>> Dtestcase=TestPerfTasksLogic -Dtests.method=testDisableCounting -
>> Dtests.seed=900F08B0BE490539 -Dtests.multiplier=3 -Dtests.slow=true -
>> Dtests.locale=sq_AL -Dtests.timezone=Europe/Luxembourg -
>> Dtests.file.encoding=ISO-8859-1
>> > [junit4:junit4] FAILURE 0.05s J0 | TestPerfTasksLogic.testDisableCounting
>> <<<
>> > [junit4:junit4]    > Throwable #1: java.lang.AssertionError
>> > [junit4:junit4]    >    at
>> __randomizedtesting.SeedInfo.seed([900F08B0BE490539:907019F611C3328B
>> ]:0)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWr
>> iter.java:73)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
>> > [junit4:junit4]    >    at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.fi
>> nish(MemoryPostingsFormat.java:271)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTerm
>> sWriterPerField.java:553)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.j
>> ava:85)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWrit
>> erPerThread.java:488)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:4
>> 22)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWrit
>> er.java:559)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:913)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.IndexWriter.close(IndexWriter.java:868)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.CloseIndexTask.doLogic(CloseIn
>> dexTask.java:48)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:143)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
>> kSequence.java:197)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
>> uence.java:138)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:143)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
>> kSequence.java:197)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
>> uence.java:138)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:143)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.jav
>> a:301)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:
>> 77)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(Bench
>> markTestCase.java:83)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.doTestDisableCou
>> nting(TestPerfTasksLogic.java:860)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testDisableCounti
>> ng(TestPerfTasksLogic.java:851)
>> > [junit4:junit4]    >    at
>> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> > [junit4:junit4]    >    at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
>> ava:88)
>> > [junit4:junit4]    >    at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
>> sorImpl.java:55)
>> > [junit4:junit4]    >    at java.lang.reflect.Method.invoke(Method.java:613)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize
>> dRunner.java:1559)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Rando
>> mizedRunner.java:79)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando
>> mizedRunner.java:737)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando
>> mizedRunner.java:773)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando
>> mizedRunner.java:787)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule
>> SetupTeardownChained.java:50)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCa
>> cheSanity.java:51)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
>> fterRule.java:46)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
>> .evaluate(SystemPropertiesInvariantRule.java:55)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
>> readAndTestName.java:49)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
>> IgnoreAfterMaxFailures.java:70)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
>> .java:48)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
>> run(ThreadLeakControl.java:358)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask
>> (ThreadLeakControl.java:782)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadL
>> eakControl.java:442)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran
>> domizedRunner.java:746)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Rando
>> mizedRunner.java:648)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Rando
>> mizedRunner.java:682)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Rando
>> mizedRunner.java:693)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
>> fterRule.java:46)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreCl
>> assName.java:42)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
>> .evaluate(SystemPropertiesInvariantRule.java:55)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
>> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
>> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAss
>> ertionsRequired.java:43)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
>> .java:48)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
>> IgnoreAfterMaxFailures.java:70)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnore
>> TestSuites.java:55)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
>> run(ThreadLeakControl.java:358)
>> > [junit4:junit4]    >    at java.lang.Thread.run(Thread.java:780)
>> > [junit4:junit4]   1> ------------> starting task: Seq
>> > [junit4:junit4]   2> NOTE: reproduce with: ant test  -
>> Dtestcase=TestPerfTasksLogic -Dtests.method=testReadTokens -
>> Dtests.seed=900F08B0BE490539 -Dtests.multiplier=3 -Dtests.slow=true -
>> Dtests.locale=sq_AL -Dtests.timezone=Europe/Luxembourg -
>> Dtests.file.encoding=ISO-8859-1
>> > [junit4:junit4] FAILURE 0.04s J0 | TestPerfTasksLogic.testReadTokens <<<
>> > [junit4:junit4]    > Throwable #1: java.lang.AssertionError
>> > [junit4:junit4]    >    at
>> __randomizedtesting.SeedInfo.seed([900F08B0BE490539:47551770DF1E00E6
>> ]:0)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWr
>> iter.java:73)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
>> > [junit4:junit4]    >    at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.fi
>> nish(MemoryPostingsFormat.java:271)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTerm
>> sWriterPerField.java:553)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.j
>> ava:85)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWrit
>> erPerThread.java:488)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:4
>> 22)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWrit
>> er.java:559)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:913)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.IndexWriter.close(IndexWriter.java:868)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.CloseIndexTask.doLogic(CloseIn
>> dexTask.java:48)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:143)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
>> kSequence.java:197)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
>> uence.java:138)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:143)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.jav
>> a:301)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:
>> 77)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(Bench
>> markTestCase.java:83)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testReadTokens(T
>> estPerfTasksLogic.java:477)
>> > [junit4:junit4]    >    at
>> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> > [junit4:junit4]    >    at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
>> ava:88)
>> > [junit4:junit4]    >    at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
>> sorImpl.java:55)
>> > [junit4:junit4]    >    at java.lang.reflect.Method.invoke(Method.java:613)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize
>> dRunner.java:1559)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Rando
>> mizedRunner.java:79)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando
>> mizedRunner.java:737)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando
>> mizedRunner.java:773)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando
>> mizedRunner.java:787)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule
>> SetupTeardownChained.java:50)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCa
>> cheSanity.java:51)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
>> fterRule.java:46)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
>> .evaluate(SystemPropertiesInvariantRule.java:55)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
>> readAndTestName.java:49)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
>> IgnoreAfterMaxFailures.java:70)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
>> .java:48)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
>> run(ThreadLeakControl.java:358)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask
>> (ThreadLeakControl.java:782)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadL
>> eakControl.java:442)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran
>> domizedRunner.java:746)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Rando
>> mizedRunner.java:648)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Rando
>> mizedRunner.java:682)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Rando
>> mizedRunner.java:693)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
>> fterRule.java:46)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreCl
>> assName.java:42)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
>> .evaluate(SystemPropertiesInvariantRule.java:55)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
>> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
>> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAss
>> ertionsRequired.java:43)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
>> .java:48)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
>> IgnoreAfterMaxFailures.java:70)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnore
>> TestSuites.java:55)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
>> run(ThreadLeakControl.java:358)
>> > [junit4:junit4]    >    at java.lang.Thread.run(Thread.java:780)
>> > [junit4:junit4]   1> ------------> starting task: Seq
>> > [junit4:junit4]   2> NOTE: reproduce with: ant test  -
>> Dtestcase=TestPerfTasksLogic -Dtests.method=testLineDocFile -
>> Dtests.seed=900F08B0BE490539 -Dtests.multiplier=3 -Dtests.slow=true -
>> Dtests.locale=sq_AL -Dtests.timezone=Europe/Luxembourg -
>> Dtests.file.encoding=ISO-8859-1
>> > [junit4:junit4] FAILURE 0.10s J0 | TestPerfTasksLogic.testLineDocFile <<<
>> > [junit4:junit4]    > Throwable #1: java.lang.AssertionError
>> > [junit4:junit4]    >    at
>> __randomizedtesting.SeedInfo.seed([900F08B0BE490539:6698ED24DD4E654
>> A]:0)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWr
>> iter.java:73)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
>> > [junit4:junit4]    >    at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.fi
>> nish(MemoryPostingsFormat.java:271)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTerm
>> sWriterPerField.java:553)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.j
>> ava:85)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWrit
>> erPerThread.java:488)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:4
>> 22)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWrit
>> er.java:559)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:913)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.IndexWriter.close(IndexWriter.java:868)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.CloseIndexTask.doLogic(CloseIn
>> dexTask.java:48)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:143)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
>> kSequence.java:197)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
>> uence.java:138)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
>> rfTask.java:143)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.jav
>> a:301)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:
>> 77)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(Bench
>> markTestCase.java:83)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testLineDocFile(Te
>> stPerfTasksLogic.java:438)
>> > [junit4:junit4]    >    at
>> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> > [junit4:junit4]    >    at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
>> ava:88)
>> > [junit4:junit4]    >    at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
>> sorImpl.java:55)
>> > [junit4:junit4]    >    at java.lang.reflect.Method.invoke(Method.java:613)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize
>> dRunner.java:1559)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Rando
>> mizedRunner.java:79)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando
>> mizedRunner.java:737)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando
>> mizedRunner.java:773)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando
>> mizedRunner.java:787)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule
>> SetupTeardownChained.java:50)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCa
>> cheSanity.java:51)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
>> fterRule.java:46)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
>> .evaluate(SystemPropertiesInvariantRule.java:55)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
>> readAndTestName.java:49)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
>> IgnoreAfterMaxFailures.java:70)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
>> .java:48)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
>> run(ThreadLeakControl.java:358)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask
>> (ThreadLeakControl.java:782)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadL
>> eakControl.java:442)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran
>> domizedRunner.java:746)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Rando
>> mizedRunner.java:648)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Rando
>> mizedRunner.java:682)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Rando
>> mizedRunner.java:693)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
>> fterRule.java:46)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreCl
>> assName.java:42)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
>> .evaluate(SystemPropertiesInvariantRule.java:55)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
>> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
>> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAss
>> ertionsRequired.java:43)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
>> .java:48)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
>> IgnoreAfterMaxFailures.java:70)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnore
>> TestSuites.java:55)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>> ementAdapter.java:36)
>> > [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
>> run(ThreadLeakControl.java:358)
>> > [junit4:junit4]    >    at java.lang.Thread.run(Thread.java:780)
>> > [junit4:junit4]   2> NOTE: test params are: codec=Lucene41:
>> {docdatenum=Lucene41(blocksize=128), doctitle=Lucene41(blocksize=128),
>> $facets=Lucene41(blocksize=128), body=PostingsFormat(name=Memory
>> doPackFST= true), docname=PostingsFormat(name=Memory doPackFST=
>> false), docdate=PostingsFormat(name=Memory doPackFST= true),
>> random_string=MockVariableIntBlock(baseBlockSize=96),
>> docid=PostingsFormat(name=Memory doPackFST= false),
>> $full_path$=MockVariableIntBlock(baseBlockSize=96),
>> country=PostingsFormat(name=Memory doPackFST= true),
>> sort_field=PostingsFormat(name=Memory doPackFST= false),
>> doctimesecnum=PostingsFormat(name=Memory doPackFST= true),
>> $payloads$=PostingsFormat(name=Memory doPackFST= false)},
>> sim=DefaultSimilarity, locale=sq_AL, timezone=Europe/Luxembourg
>> > [junit4:junit4]   2> NOTE: Linux 3.2.0-34-generic x86/IBM Corporation 1.7.0
>> (32-bit)/cpus=8,threads=1,free=11774776,total=20250624
>> > [junit4:junit4]   2> NOTE: All tests run in this JVM: [AltPackageTaskTest,
>> WriteEnwikiLineDocTaskTest, TestPerfTasksLogic]
>> > [junit4:junit4] Completed on J0 in 7.68s, 23 tests, 14 failures <<< FAILURES!
>> >
>> > [...truncated 37 lines...]
>> > BUILD FAILED
>> > /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:365: The
>> following error occurred while executing this line:
>> > /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The
>> following error occurred while executing this line:
>> > /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build.xml:519:
>> The following error occurred while executing this line:
>> > /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-
>> build.xml:1703: The following error occurred while executing this line:
>> > /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/module-
>> build.xml:61: The following error occurred while executing this line:
>> > /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-
>> build.xml:1175: The following error occurred while executing this line:
>> > /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-
>> build.xml:839: There were test failures: 17 suites, 90 tests, 14 failures
>> >
>> > Total time: 60 minutes 12 seconds
>> > Build step 'Invoke Ant' marked build as failure
>> > Archiving artifacts
>> > Recording test results
>> > Description set: Java: 32bit/ibm-j9-jdk7
>> > Email was triggered for: Failure
>> > Sending email for trigger: Failure
>> >
>> >
>> >
>> >
>> > ---------------------------------------------------------------------
>> > To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
>> > For additional commands, e-mail: dev-help@lucene.apache.org
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: dev-help@lucene.apache.org
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
>

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


RE: [JENKINS] Lucene-Solr-4.x-Linux (32bit/ibm-j9-jdk7) - Build # 3191 - Still Failing!

Posted by Uwe Schindler <uw...@thetaphi.de>.
The FST.pack() J9 bug is pack ähm back :-) 

-----
Uwe Schindler
H.-H.-Meier-Allee 63, D-28213 Bremen
http://www.thetaphi.de
eMail: uwe@thetaphi.de


> -----Original Message-----
> From: Michael McCandless [mailto:lucene@mikemccandless.com]
> Sent: Thursday, December 13, 2012 1:29 AM
> To: dev@lucene.apache.org
> Cc: yonik@apache.org; jpountz@apache.org
> Subject: Re: [JENKINS] Lucene-Solr-4.x-Linux (32bit/ibm-j9-jdk7) - Build #
> 3191 - Still Failing!
> 
> Can anyone reproduce this?
> 
> Mike McCandless
> 
> http://blog.mikemccandless.com
> 
> On Wed, Dec 12, 2012 at 6:18 PM, Policeman Jenkins Server
> <je...@sd-datasolutions.de> wrote:
> > Build: http://jenkins.sd-datasolutions.de/job/Lucene-Solr-4.x-Linux/3191/
> > Java: 32bit/ibm-j9-jdk7
> >
> > 14 tests failed.
> > REGRESSION:
> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testBGSearchTask
> Threads
> >
> > Error Message:
> >
> >
> > Stack Trace:
> > java.lang.AssertionError
> >         at
> __randomizedtesting.SeedInfo.seed([900F08B0BE490539:4D3ACD6C068AD49
> B]:0)
> >         at
> org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWr
> iter.java:73)
> >         at
> org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
> >         at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
> >         at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
> >         at
> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.fi
> nish(MemoryPostingsFormat.java:271)
> >         at
> org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTerm
> sWriterPerField.java:553)
> >         at
> org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.j
> ava:85)
> >         at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
> >         at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
> >         at
> org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
> >         at
> org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWrit
> erPerThread.java:488)
> >         at
> org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:4
> 22)
> >         at
> org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWrit
> er.java:559)
> >         at
> org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
> >         at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
> >         at
> org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1619)
> >         at
> org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1595)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.ForceMergeTask.doLogic(Force
> MergeTask.java:41)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:143)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
> kSequence.java:197)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
> uence.java:138)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:143)
> >         at
> org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.jav
> a:301)
> >         at
> org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:
> 77)
> >         at
> org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(Bench
> markTestCase.java:83)
> >         at
> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testBGSearchTask
> Threads(TestPerfTasksLogic.java:157)
> >         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
> ava:88)
> >         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
> sorImpl.java:55)
> >         at java.lang.reflect.Method.invoke(Method.java:613)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize
> dRunner.java:1559)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Rando
> mizedRunner.java:79)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando
> mizedRunner.java:737)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando
> mizedRunner.java:773)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando
> mizedRunner.java:787)
> >         at
> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule
> SetupTeardownChained.java:50)
> >         at
> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCa
> cheSanity.java:51)
> >         at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> >         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> >         at
> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
> readAndTestName.java:49)
> >         at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> >         at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> >         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask
> (ThreadLeakControl.java:782)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadL
> eakControl.java:442)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran
> domizedRunner.java:746)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Rando
> mizedRunner.java:648)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Rando
> mizedRunner.java:682)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Rando
> mizedRunner.java:693)
> >         at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> >         at
> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreCl
> assName.java:42)
> >         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> >         at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> >         at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> >         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> >         at
> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAss
> ertionsRequired.java:43)
> >         at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> >         at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> >         at
> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnore
> TestSuites.java:55)
> >         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> >         at java.lang.Thread.run(Thread.java:780)
> >
> >
> > REGRESSION:
> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testExhaustConte
> ntSource
> >
> > Error Message:
> >
> >
> > Stack Trace:
> > java.lang.AssertionError
> >         at
> __randomizedtesting.SeedInfo.seed([900F08B0BE490539:28FE72D1146C5FA0
> ]:0)
> >         at
> org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWr
> iter.java:73)
> >         at
> org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
> >         at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
> >         at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
> >         at
> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.fi
> nish(MemoryPostingsFormat.java:271)
> >         at
> org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTerm
> sWriterPerField.java:553)
> >         at
> org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.j
> ava:85)
> >         at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
> >         at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
> >         at
> org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
> >         at
> org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWrit
> erPerThread.java:488)
> >         at
> org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:4
> 22)
> >         at
> org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWrit
> er.java:559)
> >         at
> org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
> >         at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
> >         at
> org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1619)
> >         at
> org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1595)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.ForceMergeTask.doLogic(Force
> MergeTask.java:41)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:143)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
> kSequence.java:197)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
> uence.java:138)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:143)
> >         at
> org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.jav
> a:301)
> >         at
> org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:
> 77)
> >         at
> org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(Bench
> markTestCase.java:83)
> >         at
> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testExhaustConte
> ntSource(TestPerfTasksLogic.java:304)
> >         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
> ava:88)
> >         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
> sorImpl.java:55)
> >         at java.lang.reflect.Method.invoke(Method.java:613)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize
> dRunner.java:1559)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Rando
> mizedRunner.java:79)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando
> mizedRunner.java:737)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando
> mizedRunner.java:773)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando
> mizedRunner.java:787)
> >         at
> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule
> SetupTeardownChained.java:50)
> >         at
> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCa
> cheSanity.java:51)
> >         at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> >         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> >         at
> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
> readAndTestName.java:49)
> >         at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> >         at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> >         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask
> (ThreadLeakControl.java:782)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadL
> eakControl.java:442)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran
> domizedRunner.java:746)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Rando
> mizedRunner.java:648)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Rando
> mizedRunner.java:682)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Rando
> mizedRunner.java:693)
> >         at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> >         at
> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreCl
> assName.java:42)
> >         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> >         at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> >         at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> >         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> >         at
> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAss
> ertionsRequired.java:43)
> >         at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> >         at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> >         at
> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnore
> TestSuites.java:55)
> >         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> >         at java.lang.Thread.run(Thread.java:780)
> >
> >
> > REGRESSION:
> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testExhaustedLoo
> ped
> >
> > Error Message:
> >
> >
> > Stack Trace:
> > java.lang.AssertionError
> >         at
> __randomizedtesting.SeedInfo.seed([900F08B0BE490539:1AE3BB949772D23
> F]:0)
> >         at
> org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWr
> iter.java:73)
> >         at
> org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
> >         at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
> >         at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
> >         at
> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.fi
> nish(MemoryPostingsFormat.java:271)
> >         at
> org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTerm
> sWriterPerField.java:553)
> >         at
> org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.j
> ava:85)
> >         at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
> >         at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
> >         at
> org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
> >         at
> org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWrit
> erPerThread.java:488)
> >         at
> org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:4
> 22)
> >         at
> org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWrit
> er.java:559)
> >         at
> org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
> >         at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
> >         at
> org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:913)
> >         at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:868)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.CloseIndexTask.doLogic(CloseIn
> dexTask.java:48)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:143)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
> kSequence.java:197)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
> uence.java:138)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:143)
> >         at
> org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.jav
> a:301)
> >         at
> org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:
> 77)
> >         at
> org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(Bench
> markTestCase.java:83)
> >         at
> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testExhaustedLoo
> ped(TestPerfTasksLogic.java:583)
> >         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
> ava:88)
> >         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
> sorImpl.java:55)
> >         at java.lang.reflect.Method.invoke(Method.java:613)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize
> dRunner.java:1559)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Rando
> mizedRunner.java:79)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando
> mizedRunner.java:737)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando
> mizedRunner.java:773)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando
> mizedRunner.java:787)
> >         at
> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule
> SetupTeardownChained.java:50)
> >         at
> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCa
> cheSanity.java:51)
> >         at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> >         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> >         at
> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
> readAndTestName.java:49)
> >         at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> >         at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> >         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask
> (ThreadLeakControl.java:782)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadL
> eakControl.java:442)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran
> domizedRunner.java:746)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Rando
> mizedRunner.java:648)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Rando
> mizedRunner.java:682)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Rando
> mizedRunner.java:693)
> >         at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> >         at
> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreCl
> assName.java:42)
> >         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> >         at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> >         at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> >         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> >         at
> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAss
> ertionsRequired.java:43)
> >         at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> >         at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> >         at
> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnore
> TestSuites.java:55)
> >         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> >         at java.lang.Thread.run(Thread.java:780)
> >
> >
> > REGRESSION:
> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testIndexAndSear
> chTasks
> >
> > Error Message:
> >
> >
> > Stack Trace:
> > java.lang.AssertionError
> >         at
> __randomizedtesting.SeedInfo.seed([900F08B0BE490539:E3C813A59FA3EB2
> 1]:0)
> >         at
> org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWr
> iter.java:73)
> >         at
> org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
> >         at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
> >         at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
> >         at
> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.fi
> nish(MemoryPostingsFormat.java:271)
> >         at
> org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTerm
> sWriterPerField.java:553)
> >         at
> org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.j
> ava:85)
> >         at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
> >         at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
> >         at
> org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
> >         at
> org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWrit
> erPerThread.java:488)
> >         at
> org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:4
> 22)
> >         at
> org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWrit
> er.java:559)
> >         at
> org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
> >         at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
> >         at
> org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1619)
> >         at
> org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1595)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.ForceMergeTask.doLogic(Force
> MergeTask.java:41)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:143)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
> kSequence.java:197)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
> uence.java:138)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:143)
> >         at
> org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.jav
> a:301)
> >         at
> org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:
> 77)
> >         at
> org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(Bench
> markTestCase.java:83)
> >         at
> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testIndexAndSear
> chTasks(TestPerfTasksLogic.java:98)
> >         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
> ava:88)
> >         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
> sorImpl.java:55)
> >         at java.lang.reflect.Method.invoke(Method.java:613)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize
> dRunner.java:1559)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Rando
> mizedRunner.java:79)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando
> mizedRunner.java:737)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando
> mizedRunner.java:773)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando
> mizedRunner.java:787)
> >         at
> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule
> SetupTeardownChained.java:50)
> >         at
> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCa
> cheSanity.java:51)
> >         at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> >         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> >         at
> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
> readAndTestName.java:49)
> >         at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> >         at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> >         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask
> (ThreadLeakControl.java:782)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadL
> eakControl.java:442)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran
> domizedRunner.java:746)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Rando
> mizedRunner.java:648)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Rando
> mizedRunner.java:682)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Rando
> mizedRunner.java:693)
> >         at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> >         at
> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreCl
> assName.java:42)
> >         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> >         at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> >         at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> >         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> >         at
> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAss
> ertionsRequired.java:43)
> >         at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> >         at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> >         at
> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnore
> TestSuites.java:55)
> >         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> >         at java.lang.Thread.run(Thread.java:780)
> >
> >
> > REGRESSION:
> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testCloseIndexFals
> e
> >
> > Error Message:
> >
> >
> > Stack Trace:
> > java.lang.AssertionError
> >         at
> __randomizedtesting.SeedInfo.seed([900F08B0BE490539:66537D56A7655F69
> ]:0)
> >         at
> org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWr
> iter.java:73)
> >         at
> org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
> >         at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
> >         at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
> >         at
> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.fi
> nish(MemoryPostingsFormat.java:271)
> >         at
> org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTerm
> sWriterPerField.java:553)
> >         at
> org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.j
> ava:85)
> >         at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
> >         at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
> >         at
> org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
> >         at
> org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWrit
> erPerThread.java:488)
> >         at
> org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:4
> 22)
> >         at
> org.apache.lucene.index.DocumentsWriter.postUpdate(DocumentsWriter.ja
> va:316)
> >         at
> org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWr
> iter.java:389)
> >         at
> org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:14
> 58)
> >         at
> org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1133)
> >         at
> org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1114)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.AddDocTask.doLogic(AddDocTas
> k.java:70)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:132)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
> kSequence.java:197)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
> uence.java:138)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:143)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
> kSequence.java:197)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
> uence.java:138)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:143)
> >         at
> org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.jav
> a:301)
> >         at
> org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:
> 77)
> >         at
> org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(Bench
> markTestCase.java:83)
> >         at
> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testCloseIndexFals
> e(TestPerfTasksLogic.java:620)
> >         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
> ava:88)
> >         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
> sorImpl.java:55)
> >         at java.lang.reflect.Method.invoke(Method.java:613)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize
> dRunner.java:1559)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Rando
> mizedRunner.java:79)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando
> mizedRunner.java:737)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando
> mizedRunner.java:773)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando
> mizedRunner.java:787)
> >         at
> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule
> SetupTeardownChained.java:50)
> >         at
> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCa
> cheSanity.java:51)
> >         at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> >         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> >         at
> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
> readAndTestName.java:49)
> >         at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> >         at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> >         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask
> (ThreadLeakControl.java:782)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadL
> eakControl.java:442)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran
> domizedRunner.java:746)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Rando
> mizedRunner.java:648)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Rando
> mizedRunner.java:682)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Rando
> mizedRunner.java:693)
> >         at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> >         at
> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreCl
> assName.java:42)
> >         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> >         at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> >         at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> >         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> >         at
> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAss
> ertionsRequired.java:43)
> >         at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> >         at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> >         at
> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnore
> TestSuites.java:55)
> >         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> >         at java.lang.Thread.run(Thread.java:780)
> >
> >
> > REGRESSION:
> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testHighlightingTV
> >
> > Error Message:
> >
> >
> > Stack Trace:
> > java.lang.AssertionError
> >         at
> __randomizedtesting.SeedInfo.seed([900F08B0BE490539:F02D2EC62156EDA
> 0]:0)
> >         at
> org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWr
> iter.java:73)
> >         at
> org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
> >         at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
> >         at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
> >         at
> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.fi
> nish(MemoryPostingsFormat.java:271)
> >         at
> org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTerm
> sWriterPerField.java:553)
> >         at
> org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.j
> ava:85)
> >         at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
> >         at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
> >         at
> org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
> >         at
> org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWrit
> erPerThread.java:488)
> >         at
> org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:4
> 22)
> >         at
> org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWrit
> er.java:559)
> >         at
> org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
> >         at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
> >         at
> org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1619)
> >         at
> org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1595)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.ForceMergeTask.doLogic(Force
> MergeTask.java:41)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:143)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
> kSequence.java:197)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
> uence.java:138)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:143)
> >         at
> org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.jav
> a:301)
> >         at
> org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:
> 77)
> >         at
> org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(Bench
> markTestCase.java:83)
> >         at
> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testHighlightingTV
> (TestPerfTasksLogic.java:227)
> >         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
> ava:88)
> >         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
> sorImpl.java:55)
> >         at java.lang.reflect.Method.invoke(Method.java:613)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize
> dRunner.java:1559)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Rando
> mizedRunner.java:79)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando
> mizedRunner.java:737)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando
> mizedRunner.java:773)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando
> mizedRunner.java:787)
> >         at
> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule
> SetupTeardownChained.java:50)
> >         at
> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCa
> cheSanity.java:51)
> >         at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> >         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> >         at
> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
> readAndTestName.java:49)
> >         at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> >         at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> >         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask
> (ThreadLeakControl.java:782)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadL
> eakControl.java:442)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran
> domizedRunner.java:746)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Rando
> mizedRunner.java:648)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Rando
> mizedRunner.java:682)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Rando
> mizedRunner.java:693)
> >         at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> >         at
> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreCl
> assName.java:42)
> >         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> >         at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> >         at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> >         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> >         at
> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAss
> ertionsRequired.java:43)
> >         at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> >         at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> >         at
> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnore
> TestSuites.java:55)
> >         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> >         at java.lang.Thread.run(Thread.java:780)
> >
> >
> > REGRESSION:
> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testParallelExhaus
> ted
> >
> > Error Message:
> >
> >
> > Stack Trace:
> > java.lang.AssertionError
> >         at
> __randomizedtesting.SeedInfo.seed([900F08B0BE490539:D1A71DF46B96804
> 5]:0)
> >         at
> org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWr
> iter.java:73)
> >         at
> org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
> >         at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
> >         at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
> >         at
> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.fi
> nish(MemoryPostingsFormat.java:271)
> >         at
> org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTerm
> sWriterPerField.java:553)
> >         at
> org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.j
> ava:85)
> >         at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
> >         at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
> >         at
> org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
> >         at
> org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWrit
> erPerThread.java:488)
> >         at
> org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:4
> 22)
> >         at
> org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWrit
> er.java:559)
> >         at
> org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
> >         at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
> >         at
> org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:913)
> >         at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:868)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.CloseIndexTask.doLogic(CloseIn
> dexTask.java:48)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:143)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
> kSequence.java:197)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
> uence.java:138)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:143)
> >         at
> org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.jav
> a:301)
> >         at
> org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:
> 77)
> >         at
> org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(Bench
> markTestCase.java:83)
> >         at
> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testParallelExhaus
> ted(TestPerfTasksLogic.java:546)
> >         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
> ava:88)
> >         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
> sorImpl.java:55)
> >         at java.lang.reflect.Method.invoke(Method.java:613)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize
> dRunner.java:1559)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Rando
> mizedRunner.java:79)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando
> mizedRunner.java:737)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando
> mizedRunner.java:773)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando
> mizedRunner.java:787)
> >         at
> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule
> SetupTeardownChained.java:50)
> >         at
> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCa
> cheSanity.java:51)
> >         at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> >         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> >         at
> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
> readAndTestName.java:49)
> >         at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> >         at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> >         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask
> (ThreadLeakControl.java:782)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadL
> eakControl.java:442)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran
> domizedRunner.java:746)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Rando
> mizedRunner.java:648)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Rando
> mizedRunner.java:682)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Rando
> mizedRunner.java:693)
> >         at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> >         at
> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreCl
> assName.java:42)
> >         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> >         at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> >         at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> >         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> >         at
> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAss
> ertionsRequired.java:43)
> >         at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> >         at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> >         at
> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnore
> TestSuites.java:55)
> >         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> >         at java.lang.Thread.run(Thread.java:780)
> >
> >
> > REGRESSION:
> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testHighlightingNo
> TvNoStore
> >
> > Error Message:
> >
> >
> > Stack Trace:
> > java.lang.AssertionError
> >         at
> __randomizedtesting.SeedInfo.seed([900F08B0BE490539:2B1EF047A6586966
> ]:0)
> >         at
> org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWr
> iter.java:73)
> >         at
> org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
> >         at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
> >         at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
> >         at
> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.fi
> nish(MemoryPostingsFormat.java:271)
> >         at
> org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTerm
> sWriterPerField.java:553)
> >         at
> org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.j
> ava:85)
> >         at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
> >         at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
> >         at
> org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
> >         at
> org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWrit
> erPerThread.java:488)
> >         at
> org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:4
> 22)
> >         at
> org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWrit
> er.java:559)
> >         at
> org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
> >         at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
> >         at
> org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1619)
> >         at
> org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1595)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.ForceMergeTask.doLogic(Force
> MergeTask.java:41)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:143)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
> kSequence.java:197)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
> uence.java:138)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:143)
> >         at
> org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.jav
> a:301)
> >         at
> org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:
> 77)
> >         at
> org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(Bench
> markTestCase.java:83)
> >         at
> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testHighlightingNo
> TvNoStore(TestPerfTasksLogic.java:266)
> >         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
> ava:88)
> >         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
> sorImpl.java:55)
> >         at java.lang.reflect.Method.invoke(Method.java:613)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize
> dRunner.java:1559)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Rando
> mizedRunner.java:79)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando
> mizedRunner.java:737)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando
> mizedRunner.java:773)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando
> mizedRunner.java:787)
> >         at
> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule
> SetupTeardownChained.java:50)
> >         at
> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCa
> cheSanity.java:51)
> >         at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> >         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> >         at
> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
> readAndTestName.java:49)
> >         at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> >         at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> >         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask
> (ThreadLeakControl.java:782)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadL
> eakControl.java:442)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran
> domizedRunner.java:746)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Rando
> mizedRunner.java:648)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Rando
> mizedRunner.java:682)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Rando
> mizedRunner.java:693)
> >         at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> >         at
> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreCl
> assName.java:42)
> >         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> >         at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> >         at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> >         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> >         at
> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAss
> ertionsRequired.java:43)
> >         at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> >         at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> >         at
> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnore
> TestSuites.java:55)
> >         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> >         at java.lang.Thread.run(Thread.java:780)
> >
> >
> > REGRESSION:
> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testIndexWriterSe
> ttings
> >
> > Error Message:
> >
> >
> > Stack Trace:
> > java.lang.AssertionError
> >         at
> __randomizedtesting.SeedInfo.seed([900F08B0BE490539:A8E67B1D32305055
> ]:0)
> >         at
> org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWr
> iter.java:73)
> >         at
> org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
> >         at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
> >         at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
> >         at
> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.fi
> nish(MemoryPostingsFormat.java:271)
> >         at
> org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTerm
> sWriterPerField.java:553)
> >         at
> org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.j
> ava:85)
> >         at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
> >         at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
> >         at
> org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
> >         at
> org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWrit
> erPerThread.java:488)
> >         at
> org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:4
> 22)
> >         at
> org.apache.lucene.index.DocumentsWriter.postUpdate(DocumentsWriter.ja
> va:316)
> >         at
> org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWr
> iter.java:389)
> >         at
> org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:14
> 58)
> >         at
> org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1133)
> >         at
> org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1114)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.AddDocTask.doLogic(AddDocTas
> k.java:70)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:132)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
> kSequence.java:197)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
> uence.java:138)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:143)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
> kSequence.java:197)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
> uence.java:138)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:143)
> >         at
> org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.jav
> a:301)
> >         at
> org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:
> 77)
> >         at
> org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(Bench
> markTestCase.java:83)
> >         at
> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testIndexWriterSe
> ttings(TestPerfTasksLogic.java:752)
> >         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
> ava:88)
> >         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
> sorImpl.java:55)
> >         at java.lang.reflect.Method.invoke(Method.java:613)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize
> dRunner.java:1559)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Rando
> mizedRunner.java:79)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando
> mizedRunner.java:737)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando
> mizedRunner.java:773)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando
> mizedRunner.java:787)
> >         at
> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule
> SetupTeardownChained.java:50)
> >         at
> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCa
> cheSanity.java:51)
> >         at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> >         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> >         at
> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
> readAndTestName.java:49)
> >         at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> >         at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> >         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask
> (ThreadLeakControl.java:782)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadL
> eakControl.java:442)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran
> domizedRunner.java:746)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Rando
> mizedRunner.java:648)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Rando
> mizedRunner.java:682)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Rando
> mizedRunner.java:693)
> >         at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> >         at
> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreCl
> assName.java:42)
> >         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> >         at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> >         at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> >         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> >         at
> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAss
> ertionsRequired.java:43)
> >         at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> >         at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> >         at
> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnore
> TestSuites.java:55)
> >         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> >         at java.lang.Thread.run(Thread.java:780)
> >
> >
> > REGRESSION:
> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testIndexingWithF
> acets
> >
> > Error Message:
> >
> >
> > Stack Trace:
> > java.lang.AssertionError
> >         at
> __randomizedtesting.SeedInfo.seed([900F08B0BE490539:B1ADCFFDAC233B
> D9]:0)
> >         at
> org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWr
> iter.java:73)
> >         at
> org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
> >         at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
> >         at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
> >         at
> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.fi
> nish(MemoryPostingsFormat.java:271)
> >         at
> org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTerm
> sWriterPerField.java:553)
> >         at
> org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.j
> ava:85)
> >         at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
> >         at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
> >         at
> org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
> >         at
> org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWrit
> erPerThread.java:488)
> >         at
> org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:4
> 22)
> >         at
> org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWrit
> er.java:559)
> >         at
> org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
> >         at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
> >         at
> org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:913)
> >         at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:868)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.CloseIndexTask.doLogic(CloseIn
> dexTask.java:48)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:143)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
> kSequence.java:197)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
> uence.java:138)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:143)
> >         at
> org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.jav
> a:301)
> >         at
> org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:
> 77)
> >         at
> org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(Bench
> markTestCase.java:83)
> >         at
> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testIndexingWithF
> acets(TestPerfTasksLogic.java:794)
> >         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
> ava:88)
> >         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
> sorImpl.java:55)
> >         at java.lang.reflect.Method.invoke(Method.java:613)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize
> dRunner.java:1559)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Rando
> mizedRunner.java:79)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando
> mizedRunner.java:737)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando
> mizedRunner.java:773)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando
> mizedRunner.java:787)
> >         at
> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule
> SetupTeardownChained.java:50)
> >         at
> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCa
> cheSanity.java:51)
> >         at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> >         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> >         at
> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
> readAndTestName.java:49)
> >         at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> >         at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> >         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask
> (ThreadLeakControl.java:782)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadL
> eakControl.java:442)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran
> domizedRunner.java:746)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Rando
> mizedRunner.java:648)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Rando
> mizedRunner.java:682)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Rando
> mizedRunner.java:693)
> >         at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> >         at
> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreCl
> assName.java:42)
> >         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> >         at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> >         at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> >         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> >         at
> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAss
> ertionsRequired.java:43)
> >         at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> >         at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> >         at
> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnore
> TestSuites.java:55)
> >         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> >         at java.lang.Thread.run(Thread.java:780)
> >
> >
> > REGRESSION:
> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testTimedSearchT
> ask
> >
> > Error Message:
> >
> >
> > Stack Trace:
> > java.lang.AssertionError
> >         at
> __randomizedtesting.SeedInfo.seed([900F08B0BE490539:652B526DF64A34D
> 3]:0)
> >         at
> org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWr
> iter.java:73)
> >         at
> org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
> >         at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
> >         at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
> >         at
> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.fi
> nish(MemoryPostingsFormat.java:271)
> >         at
> org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTerm
> sWriterPerField.java:553)
> >         at
> org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.j
> ava:85)
> >         at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
> >         at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
> >         at
> org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
> >         at
> org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWrit
> erPerThread.java:488)
> >         at
> org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:4
> 22)
> >         at
> org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWrit
> er.java:559)
> >         at
> org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
> >         at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
> >         at
> org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1619)
> >         at
> org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1595)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.ForceMergeTask.doLogic(Force
> MergeTask.java:41)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:143)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
> kSequence.java:197)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
> uence.java:138)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:143)
> >         at
> org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.jav
> a:301)
> >         at
> org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:
> 77)
> >         at
> org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(Bench
> markTestCase.java:83)
> >         at
> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testTimedSearchT
> ask(TestPerfTasksLogic.java:130)
> >         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
> ava:88)
> >         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
> sorImpl.java:55)
> >         at java.lang.reflect.Method.invoke(Method.java:613)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize
> dRunner.java:1559)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Rando
> mizedRunner.java:79)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando
> mizedRunner.java:737)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando
> mizedRunner.java:773)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando
> mizedRunner.java:787)
> >         at
> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule
> SetupTeardownChained.java:50)
> >         at
> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCa
> cheSanity.java:51)
> >         at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> >         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> >         at
> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
> readAndTestName.java:49)
> >         at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> >         at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> >         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask
> (ThreadLeakControl.java:782)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadL
> eakControl.java:442)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran
> domizedRunner.java:746)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Rando
> mizedRunner.java:648)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Rando
> mizedRunner.java:682)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Rando
> mizedRunner.java:693)
> >         at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> >         at
> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreCl
> assName.java:42)
> >         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> >         at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> >         at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> >         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> >         at
> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAss
> ertionsRequired.java:43)
> >         at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> >         at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> >         at
> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnore
> TestSuites.java:55)
> >         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> >         at java.lang.Thread.run(Thread.java:780)
> >
> >
> > REGRESSION:
> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testDisableCounti
> ng
> >
> > Error Message:
> >
> >
> > Stack Trace:
> > java.lang.AssertionError
> >         at
> __randomizedtesting.SeedInfo.seed([900F08B0BE490539:907019F611C3328B
> ]:0)
> >         at
> org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWr
> iter.java:73)
> >         at
> org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
> >         at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
> >         at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
> >         at
> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.fi
> nish(MemoryPostingsFormat.java:271)
> >         at
> org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTerm
> sWriterPerField.java:553)
> >         at
> org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.j
> ava:85)
> >         at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
> >         at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
> >         at
> org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
> >         at
> org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWrit
> erPerThread.java:488)
> >         at
> org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:4
> 22)
> >         at
> org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWrit
> er.java:559)
> >         at
> org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
> >         at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
> >         at
> org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:913)
> >         at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:868)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.CloseIndexTask.doLogic(CloseIn
> dexTask.java:48)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:143)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
> kSequence.java:197)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
> uence.java:138)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:143)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
> kSequence.java:197)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
> uence.java:138)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:143)
> >         at
> org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.jav
> a:301)
> >         at
> org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:
> 77)
> >         at
> org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(Bench
> markTestCase.java:83)
> >         at
> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.doTestDisableCou
> nting(TestPerfTasksLogic.java:860)
> >         at
> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testDisableCounti
> ng(TestPerfTasksLogic.java:851)
> >         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
> ava:88)
> >         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
> sorImpl.java:55)
> >         at java.lang.reflect.Method.invoke(Method.java:613)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize
> dRunner.java:1559)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Rando
> mizedRunner.java:79)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando
> mizedRunner.java:737)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando
> mizedRunner.java:773)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando
> mizedRunner.java:787)
> >         at
> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule
> SetupTeardownChained.java:50)
> >         at
> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCa
> cheSanity.java:51)
> >         at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> >         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> >         at
> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
> readAndTestName.java:49)
> >         at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> >         at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> >         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask
> (ThreadLeakControl.java:782)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadL
> eakControl.java:442)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran
> domizedRunner.java:746)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Rando
> mizedRunner.java:648)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Rando
> mizedRunner.java:682)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Rando
> mizedRunner.java:693)
> >         at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> >         at
> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreCl
> assName.java:42)
> >         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> >         at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> >         at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> >         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> >         at
> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAss
> ertionsRequired.java:43)
> >         at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> >         at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> >         at
> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnore
> TestSuites.java:55)
> >         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> >         at java.lang.Thread.run(Thread.java:780)
> >
> >
> > REGRESSION:
> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testReadTokens
> >
> > Error Message:
> >
> >
> > Stack Trace:
> > java.lang.AssertionError
> >         at
> __randomizedtesting.SeedInfo.seed([900F08B0BE490539:47551770DF1E00E6
> ]:0)
> >         at
> org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWr
> iter.java:73)
> >         at
> org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
> >         at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
> >         at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
> >         at
> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.fi
> nish(MemoryPostingsFormat.java:271)
> >         at
> org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTerm
> sWriterPerField.java:553)
> >         at
> org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.j
> ava:85)
> >         at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
> >         at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
> >         at
> org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
> >         at
> org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWrit
> erPerThread.java:488)
> >         at
> org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:4
> 22)
> >         at
> org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWrit
> er.java:559)
> >         at
> org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
> >         at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
> >         at
> org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:913)
> >         at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:868)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.CloseIndexTask.doLogic(CloseIn
> dexTask.java:48)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:143)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
> kSequence.java:197)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
> uence.java:138)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:143)
> >         at
> org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.jav
> a:301)
> >         at
> org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:
> 77)
> >         at
> org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(Bench
> markTestCase.java:83)
> >         at
> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testReadTokens(T
> estPerfTasksLogic.java:477)
> >         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
> ava:88)
> >         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
> sorImpl.java:55)
> >         at java.lang.reflect.Method.invoke(Method.java:613)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize
> dRunner.java:1559)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Rando
> mizedRunner.java:79)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando
> mizedRunner.java:737)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando
> mizedRunner.java:773)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando
> mizedRunner.java:787)
> >         at
> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule
> SetupTeardownChained.java:50)
> >         at
> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCa
> cheSanity.java:51)
> >         at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> >         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> >         at
> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
> readAndTestName.java:49)
> >         at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> >         at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> >         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask
> (ThreadLeakControl.java:782)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadL
> eakControl.java:442)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran
> domizedRunner.java:746)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Rando
> mizedRunner.java:648)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Rando
> mizedRunner.java:682)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Rando
> mizedRunner.java:693)
> >         at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> >         at
> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreCl
> assName.java:42)
> >         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> >         at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> >         at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> >         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> >         at
> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAss
> ertionsRequired.java:43)
> >         at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> >         at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> >         at
> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnore
> TestSuites.java:55)
> >         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> >         at java.lang.Thread.run(Thread.java:780)
> >
> >
> > REGRESSION:
> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testLineDocFile
> >
> > Error Message:
> >
> >
> > Stack Trace:
> > java.lang.AssertionError
> >         at
> __randomizedtesting.SeedInfo.seed([900F08B0BE490539:6698ED24DD4E654
> A]:0)
> >         at
> org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWr
> iter.java:73)
> >         at
> org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
> >         at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
> >         at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
> >         at
> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.fi
> nish(MemoryPostingsFormat.java:271)
> >         at
> org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTerm
> sWriterPerField.java:553)
> >         at
> org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.j
> ava:85)
> >         at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
> >         at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
> >         at
> org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
> >         at
> org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWrit
> erPerThread.java:488)
> >         at
> org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:4
> 22)
> >         at
> org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWrit
> er.java:559)
> >         at
> org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
> >         at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
> >         at
> org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:913)
> >         at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:868)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.CloseIndexTask.doLogic(CloseIn
> dexTask.java:48)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:143)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
> kSequence.java:197)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
> uence.java:138)
> >         at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:143)
> >         at
> org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.jav
> a:301)
> >         at
> org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:
> 77)
> >         at
> org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(Bench
> markTestCase.java:83)
> >         at
> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testLineDocFile(Te
> stPerfTasksLogic.java:438)
> >         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
> ava:88)
> >         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
> sorImpl.java:55)
> >         at java.lang.reflect.Method.invoke(Method.java:613)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize
> dRunner.java:1559)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Rando
> mizedRunner.java:79)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando
> mizedRunner.java:737)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando
> mizedRunner.java:773)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando
> mizedRunner.java:787)
> >         at
> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule
> SetupTeardownChained.java:50)
> >         at
> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCa
> cheSanity.java:51)
> >         at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> >         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> >         at
> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
> readAndTestName.java:49)
> >         at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> >         at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> >         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask
> (ThreadLeakControl.java:782)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadL
> eakControl.java:442)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran
> domizedRunner.java:746)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Rando
> mizedRunner.java:648)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Rando
> mizedRunner.java:682)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Rando
> mizedRunner.java:693)
> >         at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> >         at
> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreCl
> assName.java:42)
> >         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> >         at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> >         at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> >         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> >         at
> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAss
> ertionsRequired.java:43)
> >         at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> >         at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> >         at
> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnore
> TestSuites.java:55)
> >         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> >         at java.lang.Thread.run(Thread.java:780)
> >
> >
> >
> >
> > Build Log:
> > [...truncated 6122 lines...]
> > [junit4:junit4] Suite:
> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic
> > [junit4:junit4]   1> ------------> starting task: Seq
> > [junit4:junit4]   1> ------------> starting task: Seq
> > [junit4:junit4]   1> ------------> starting task: Seq
> > [junit4:junit4]   1> ------------> starting task: Seq
> > [junit4:junit4]   2> NOTE: reproduce with: ant test  -
> Dtestcase=TestPerfTasksLogic -Dtests.method=testBGSearchTaskThreads -
> Dtests.seed=900F08B0BE490539 -Dtests.multiplier=3 -Dtests.slow=true -
> Dtests.locale=sq_AL -Dtests.timezone=Europe/Luxembourg -
> Dtests.file.encoding=ISO-8859-1
> > [junit4:junit4] FAILURE 0.63s J0 |
> TestPerfTasksLogic.testBGSearchTaskThreads <<<
> > [junit4:junit4]    > Throwable #1: java.lang.AssertionError
> > [junit4:junit4]    >    at
> __randomizedtesting.SeedInfo.seed([900F08B0BE490539:4D3ACD6C068AD49
> B]:0)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWr
> iter.java:73)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
> > [junit4:junit4]    >    at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
> > [junit4:junit4]    >    at
> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.fi
> nish(MemoryPostingsFormat.java:271)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTerm
> sWriterPerField.java:553)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.j
> ava:85)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWrit
> erPerThread.java:488)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:4
> 22)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWrit
> er.java:559)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1619)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1595)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.ForceMergeTask.doLogic(Force
> MergeTask.java:41)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:143)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
> kSequence.java:197)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
> uence.java:138)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:143)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.jav
> a:301)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:
> 77)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(Bench
> markTestCase.java:83)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testBGSearchTask
> Threads(TestPerfTasksLogic.java:157)
> > [junit4:junit4]    >    at
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > [junit4:junit4]    >    at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
> ava:88)
> > [junit4:junit4]    >    at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
> sorImpl.java:55)
> > [junit4:junit4]    >    at java.lang.reflect.Method.invoke(Method.java:613)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize
> dRunner.java:1559)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Rando
> mizedRunner.java:79)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando
> mizedRunner.java:737)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando
> mizedRunner.java:773)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando
> mizedRunner.java:787)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule
> SetupTeardownChained.java:50)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCa
> cheSanity.java:51)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
> readAndTestName.java:49)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask
> (ThreadLeakControl.java:782)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadL
> eakControl.java:442)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran
> domizedRunner.java:746)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Rando
> mizedRunner.java:648)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Rando
> mizedRunner.java:682)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Rando
> mizedRunner.java:693)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreCl
> assName.java:42)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAss
> ertionsRequired.java:43)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnore
> TestSuites.java:55)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> > [junit4:junit4]    >    at java.lang.Thread.run(Thread.java:780)
> > [junit4:junit4]   1> ------------> starting task: Seq
> > [junit4:junit4]   2> NOTE: reproduce with: ant test  -
> Dtestcase=TestPerfTasksLogic -Dtests.method=testExhaustContentSource -
> Dtests.seed=900F08B0BE490539 -Dtests.multiplier=3 -Dtests.slow=true -
> Dtests.locale=sq_AL -Dtests.timezone=Europe/Luxembourg -
> Dtests.file.encoding=ISO-8859-1
> > [junit4:junit4] FAILURE 0.05s J0 |
> TestPerfTasksLogic.testExhaustContentSource <<<
> > [junit4:junit4]    > Throwable #1: java.lang.AssertionError
> > [junit4:junit4]    >    at
> __randomizedtesting.SeedInfo.seed([900F08B0BE490539:28FE72D1146C5FA0
> ]:0)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWr
> iter.java:73)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
> > [junit4:junit4]    >    at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
> > [junit4:junit4]    >    at
> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.fi
> nish(MemoryPostingsFormat.java:271)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTerm
> sWriterPerField.java:553)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.j
> ava:85)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWrit
> erPerThread.java:488)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:4
> 22)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWrit
> er.java:559)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1619)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1595)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.ForceMergeTask.doLogic(Force
> MergeTask.java:41)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:143)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
> kSequence.java:197)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
> uence.java:138)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:143)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.jav
> a:301)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:
> 77)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(Bench
> markTestCase.java:83)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testExhaustConte
> ntSource(TestPerfTasksLogic.java:304)
> > [junit4:junit4]    >    at
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > [junit4:junit4]    >    at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
> ava:88)
> > [junit4:junit4]    >    at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
> sorImpl.java:55)
> > [junit4:junit4]    >    at java.lang.reflect.Method.invoke(Method.java:613)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize
> dRunner.java:1559)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Rando
> mizedRunner.java:79)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando
> mizedRunner.java:737)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando
> mizedRunner.java:773)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando
> mizedRunner.java:787)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule
> SetupTeardownChained.java:50)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCa
> cheSanity.java:51)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
> readAndTestName.java:49)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask
> (ThreadLeakControl.java:782)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadL
> eakControl.java:442)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran
> domizedRunner.java:746)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Rando
> mizedRunner.java:648)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Rando
> mizedRunner.java:682)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Rando
> mizedRunner.java:693)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreCl
> assName.java:42)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAss
> ertionsRequired.java:43)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnore
> TestSuites.java:55)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> > [junit4:junit4]    >    at java.lang.Thread.run(Thread.java:780)
> > [junit4:junit4]   1> Changed Locale to: null
> > [junit4:junit4]   1>
> > [junit4:junit4]   1> --> Round 0-->1
> > [junit4:junit4]   1>
> > [junit4:junit4]   1> Changed Locale to: root locale
> > [junit4:junit4]   1>
> > [junit4:junit4]   1> --> Round 0-->1
> > [junit4:junit4]   1>
> > [junit4:junit4]   1> Changed Locale to: de
> > [junit4:junit4]   1>
> > [junit4:junit4]   1> --> Round 0-->1
> > [junit4:junit4]   1>
> > [junit4:junit4]   1> Changed Locale to: en_US
> > [junit4:junit4]   1>
> > [junit4:junit4]   1> --> Round 0-->1
> > [junit4:junit4]   1>
> > [junit4:junit4]   1> Changed Locale to: no_NO_NY
> > [junit4:junit4]   1>
> > [junit4:junit4]   1> --> Round 0-->1
> > [junit4:junit4]   1>
> > [junit4:junit4]   1> ------------> starting task: Rounds_2
> > [junit4:junit4]   2> NOTE: reproduce with: ant test  -
> Dtestcase=TestPerfTasksLogic -Dtests.method=testExhaustedLooped -
> Dtests.seed=900F08B0BE490539 -Dtests.multiplier=3 -Dtests.slow=true -
> Dtests.locale=sq_AL -Dtests.timezone=Europe/Luxembourg -
> Dtests.file.encoding=ISO-8859-1
> > [junit4:junit4] FAILURE 0.06s J0 | TestPerfTasksLogic.testExhaustedLooped
> <<<
> > [junit4:junit4]    > Throwable #1: java.lang.AssertionError
> > [junit4:junit4]    >    at
> __randomizedtesting.SeedInfo.seed([900F08B0BE490539:1AE3BB949772D23
> F]:0)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWr
> iter.java:73)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
> > [junit4:junit4]    >    at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
> > [junit4:junit4]    >    at
> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.fi
> nish(MemoryPostingsFormat.java:271)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTerm
> sWriterPerField.java:553)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.j
> ava:85)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWrit
> erPerThread.java:488)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:4
> 22)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWrit
> er.java:559)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:913)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.IndexWriter.close(IndexWriter.java:868)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.CloseIndexTask.doLogic(CloseIn
> dexTask.java:48)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:143)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
> kSequence.java:197)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
> uence.java:138)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:143)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.jav
> a:301)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:
> 77)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(Bench
> markTestCase.java:83)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testExhaustedLoo
> ped(TestPerfTasksLogic.java:583)
> > [junit4:junit4]    >    at
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > [junit4:junit4]    >    at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
> ava:88)
> > [junit4:junit4]    >    at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
> sorImpl.java:55)
> > [junit4:junit4]    >    at java.lang.reflect.Method.invoke(Method.java:613)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize
> dRunner.java:1559)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Rando
> mizedRunner.java:79)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando
> mizedRunner.java:737)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando
> mizedRunner.java:773)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando
> mizedRunner.java:787)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule
> SetupTeardownChained.java:50)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCa
> cheSanity.java:51)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
> readAndTestName.java:49)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask
> (ThreadLeakControl.java:782)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadL
> eakControl.java:442)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran
> domizedRunner.java:746)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Rando
> mizedRunner.java:648)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Rando
> mizedRunner.java:682)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Rando
> mizedRunner.java:693)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreCl
> assName.java:42)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAss
> ertionsRequired.java:43)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnore
> TestSuites.java:55)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> > [junit4:junit4]    >    at java.lang.Thread.run(Thread.java:780)
> > [junit4:junit4]   1> ------------> starting task: Seq
> > [junit4:junit4]   1> Changed Analyzer to: ShingleAnalyzerWrapper, wrapping
> ShingleFilter over org.apache.lucene.analysis.standard.StandardAnalyzer
> > [junit4:junit4]   1> ------------> starting task: Seq
> > [junit4:junit4]   1> Changed Analyzer to: ShingleAnalyzerWrapper, wrapping
> ShingleFilter over org.apache.lucene.analysis.standard.StandardAnalyzer
> > [junit4:junit4]   1> ------------> starting task: Seq
> > [junit4:junit4]   1> Changed Analyzer to: ShingleAnalyzerWrapper, wrapping
> ShingleFilter over org.apache.lucene.analysis.core.WhitespaceAnalyzer
> > [junit4:junit4]   1> ------------> starting task: Seq
> > [junit4:junit4]   1> Changed Analyzer to: ShingleAnalyzerWrapper, wrapping
> ShingleFilter over org.apache.lucene.analysis.core.WhitespaceAnalyzer
> > [junit4:junit4]   1> ------------> starting task: Seq
> > [junit4:junit4]   1>    0.16 sec --> TEST-
> TestPerfTasksLogic.testIndexAndSearchTasks-seed#[900F08B0BE490539]
> added      1000 docs
> > [junit4:junit4]   2> NOTE: reproduce with: ant test  -
> Dtestcase=TestPerfTasksLogic -Dtests.method=testIndexAndSearchTasks -
> Dtests.seed=900F08B0BE490539 -Dtests.multiplier=3 -Dtests.slow=true -
> Dtests.locale=sq_AL -Dtests.timezone=Europe/Luxembourg -
> Dtests.file.encoding=ISO-8859-1
> > [junit4:junit4] FAILURE 0.25s J0 |
> TestPerfTasksLogic.testIndexAndSearchTasks <<<
> > [junit4:junit4]    > Throwable #1: java.lang.AssertionError
> > [junit4:junit4]    >    at
> __randomizedtesting.SeedInfo.seed([900F08B0BE490539:E3C813A59FA3EB2
> 1]:0)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWr
> iter.java:73)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
> > [junit4:junit4]    >    at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
> > [junit4:junit4]    >    at
> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.fi
> nish(MemoryPostingsFormat.java:271)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTerm
> sWriterPerField.java:553)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.j
> ava:85)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWrit
> erPerThread.java:488)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:4
> 22)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWrit
> er.java:559)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1619)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1595)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.ForceMergeTask.doLogic(Force
> MergeTask.java:41)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:143)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
> kSequence.java:197)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
> uence.java:138)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:143)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.jav
> a:301)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:
> 77)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(Bench
> markTestCase.java:83)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testIndexAndSear
> chTasks(TestPerfTasksLogic.java:98)
> > [junit4:junit4]    >    at
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > [junit4:junit4]    >    at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
> ava:88)
> > [junit4:junit4]    >    at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
> sorImpl.java:55)
> > [junit4:junit4]    >    at java.lang.reflect.Method.invoke(Method.java:613)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize
> dRunner.java:1559)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Rando
> mizedRunner.java:79)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando
> mizedRunner.java:737)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando
> mizedRunner.java:773)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando
> mizedRunner.java:787)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule
> SetupTeardownChained.java:50)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCa
> cheSanity.java:51)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
> readAndTestName.java:49)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask
> (ThreadLeakControl.java:782)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadL
> eakControl.java:442)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran
> domizedRunner.java:746)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Rando
> mizedRunner.java:648)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Rando
> mizedRunner.java:682)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Rando
> mizedRunner.java:693)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreCl
> assName.java:42)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAss
> ertionsRequired.java:43)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnore
> TestSuites.java:55)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> > [junit4:junit4]    >    at java.lang.Thread.run(Thread.java:780)
> > [junit4:junit4]   2> NOTE: reproduce with: ant test  -
> Dtestcase=TestPerfTasksLogic -Dtests.method=testCloseIndexFalse -
> Dtests.seed=900F08B0BE490539 -Dtests.multiplier=3 -Dtests.slow=true -
> Dtests.locale=sq_AL -Dtests.timezone=Europe/Luxembourg -
> Dtests.file.encoding=ISO-8859-1
> > [junit4:junit4] FAILURE 0.07s J0 | TestPerfTasksLogic.testCloseIndexFalse
> <<<
> > [junit4:junit4]    > Throwable #1: java.lang.AssertionError
> > [junit4:junit4]    >    at
> __randomizedtesting.SeedInfo.seed([900F08B0BE490539:66537D56A7655F69
> ]:0)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWr
> iter.java:73)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
> > [junit4:junit4]    >    at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
> > [junit4:junit4]    >    at
> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.fi
> nish(MemoryPostingsFormat.java:271)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTerm
> sWriterPerField.java:553)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.j
> ava:85)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWrit
> erPerThread.java:488)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:4
> 22)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocumentsWriter.postUpdate(DocumentsWriter.ja
> va:316)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWr
> iter.java:389)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:14
> 58)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1133)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1114)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.AddDocTask.doLogic(AddDocTas
> k.java:70)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:132)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
> kSequence.java:197)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
> uence.java:138)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:143)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
> kSequence.java:197)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
> uence.java:138)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:143)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.jav
> a:301)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:
> 77)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(Bench
> markTestCase.java:83)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testCloseIndexFals
> e(TestPerfTasksLogic.java:620)
> > [junit4:junit4]    >    at
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > [junit4:junit4]    >    at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
> ava:88)
> > [junit4:junit4]    >    at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
> sorImpl.java:55)
> > [junit4:junit4]    >    at java.lang.reflect.Method.invoke(Method.java:613)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize
> dRunner.java:1559)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Rando
> mizedRunner.java:79)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando
> mizedRunner.java:737)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando
> mizedRunner.java:773)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando
> mizedRunner.java:787)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule
> SetupTeardownChained.java:50)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCa
> cheSanity.java:51)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
> readAndTestName.java:49)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask
> (ThreadLeakControl.java:782)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadL
> eakControl.java:442)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran
> domizedRunner.java:746)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Rando
> mizedRunner.java:648)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Rando
> mizedRunner.java:682)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Rando
> mizedRunner.java:693)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreCl
> assName.java:42)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAss
> ertionsRequired.java:43)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnore
> TestSuites.java:55)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> > [junit4:junit4]    >    at java.lang.Thread.run(Thread.java:780)
> > [junit4:junit4]   1> ------------> starting task: Seq
> > [junit4:junit4]   1>    0.69 sec --> TEST-
> TestPerfTasksLogic.testHighlightingTV-seed#[900F08B0BE490539] added
> 1000 docs
> > [junit4:junit4]   2> NOTE: reproduce with: ant test  -
> Dtestcase=TestPerfTasksLogic -Dtests.method=testHighlightingTV -
> Dtests.seed=900F08B0BE490539 -Dtests.multiplier=3 -Dtests.slow=true -
> Dtests.locale=sq_AL -Dtests.timezone=Europe/Luxembourg -
> Dtests.file.encoding=ISO-8859-1
> > [junit4:junit4] FAILURE 0.89s J0 | TestPerfTasksLogic.testHighlightingTV <<<
> > [junit4:junit4]    > Throwable #1: java.lang.AssertionError
> > [junit4:junit4]    >    at
> __randomizedtesting.SeedInfo.seed([900F08B0BE490539:F02D2EC62156EDA
> 0]:0)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWr
> iter.java:73)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
> > [junit4:junit4]    >    at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
> > [junit4:junit4]    >    at
> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.fi
> nish(MemoryPostingsFormat.java:271)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTerm
> sWriterPerField.java:553)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.j
> ava:85)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWrit
> erPerThread.java:488)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:4
> 22)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWrit
> er.java:559)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1619)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1595)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.ForceMergeTask.doLogic(Force
> MergeTask.java:41)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:143)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
> kSequence.java:197)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
> uence.java:138)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:143)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.jav
> a:301)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:
> 77)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(Bench
> markTestCase.java:83)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testHighlightingTV
> (TestPerfTasksLogic.java:227)
> > [junit4:junit4]    >    at
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > [junit4:junit4]    >    at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
> ava:88)
> > [junit4:junit4]    >    at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
> sorImpl.java:55)
> > [junit4:junit4]    >    at java.lang.reflect.Method.invoke(Method.java:613)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize
> dRunner.java:1559)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Rando
> mizedRunner.java:79)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando
> mizedRunner.java:737)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando
> mizedRunner.java:773)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando
> mizedRunner.java:787)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule
> SetupTeardownChained.java:50)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCa
> cheSanity.java:51)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
> readAndTestName.java:49)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask
> (ThreadLeakControl.java:782)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadL
> eakControl.java:442)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran
> domizedRunner.java:746)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Rando
> mizedRunner.java:648)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Rando
> mizedRunner.java:682)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Rando
> mizedRunner.java:693)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreCl
> assName.java:42)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAss
> ertionsRequired.java:43)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnore
> TestSuites.java:55)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> > [junit4:junit4]    >    at java.lang.Thread.run(Thread.java:780)
> > [junit4:junit4]   1> ------------> starting task: Seq
> > [junit4:junit4]   1> ------------> starting task: CreateIndex
> > [junit4:junit4]   1> ------------> starting task: Seq_Exhaust
> > [junit4:junit4]   1> ------------> starting task: Seq_Exhaust
> > [junit4:junit4]   1> ------------> starting task: WaitForMerges
> > [junit4:junit4]   1> ------------> starting task: CloseIndex
> > [junit4:junit4]   2> NOTE: reproduce with: ant test  -
> Dtestcase=TestPerfTasksLogic -Dtests.method=testParallelExhausted -
> Dtests.seed=900F08B0BE490539 -Dtests.multiplier=3 -Dtests.slow=true -
> Dtests.locale=sq_AL -Dtests.timezone=Europe/Luxembourg -
> Dtests.file.encoding=ISO-8859-1
> > [junit4:junit4] FAILURE 0.10s J0 | TestPerfTasksLogic.testParallelExhausted
> <<<
> > [junit4:junit4]    > Throwable #1: java.lang.AssertionError
> > [junit4:junit4]    >    at
> __randomizedtesting.SeedInfo.seed([900F08B0BE490539:D1A71DF46B96804
> 5]:0)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWr
> iter.java:73)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
> > [junit4:junit4]    >    at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
> > [junit4:junit4]    >    at
> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.fi
> nish(MemoryPostingsFormat.java:271)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTerm
> sWriterPerField.java:553)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.j
> ava:85)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWrit
> erPerThread.java:488)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:4
> 22)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWrit
> er.java:559)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:913)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.IndexWriter.close(IndexWriter.java:868)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.CloseIndexTask.doLogic(CloseIn
> dexTask.java:48)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:143)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
> kSequence.java:197)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
> uence.java:138)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:143)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.jav
> a:301)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:
> 77)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(Bench
> markTestCase.java:83)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testParallelExhaus
> ted(TestPerfTasksLogic.java:546)
> > [junit4:junit4]    >    at
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > [junit4:junit4]    >    at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
> ava:88)
> > [junit4:junit4]    >    at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
> sorImpl.java:55)
> > [junit4:junit4]    >    at java.lang.reflect.Method.invoke(Method.java:613)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize
> dRunner.java:1559)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Rando
> mizedRunner.java:79)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando
> mizedRunner.java:737)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando
> mizedRunner.java:773)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando
> mizedRunner.java:787)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule
> SetupTeardownChained.java:50)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCa
> cheSanity.java:51)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
> readAndTestName.java:49)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask
> (ThreadLeakControl.java:782)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadL
> eakControl.java:442)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran
> domizedRunner.java:746)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Rando
> mizedRunner.java:648)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Rando
> mizedRunner.java:682)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Rando
> mizedRunner.java:693)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreCl
> assName.java:42)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAss
> ertionsRequired.java:43)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnore
> TestSuites.java:55)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> > [junit4:junit4]    >    at java.lang.Thread.run(Thread.java:780)
> > [junit4:junit4]   1> ------------> starting task: Seq
> > [junit4:junit4]   1>    0.22 sec --> TEST-
> TestPerfTasksLogic.testHighlightingNoTvNoStore-seed#[900F08B0BE490539]
> added      1000 docs
> > [junit4:junit4]   2> NOTE: reproduce with: ant test  -
> Dtestcase=TestPerfTasksLogic -Dtests.method=testHighlightingNoTvNoStore
> -Dtests.seed=900F08B0BE490539 -Dtests.multiplier=3 -Dtests.slow=true -
> Dtests.locale=sq_AL -Dtests.timezone=Europe/Luxembourg -
> Dtests.file.encoding=ISO-8859-1
> > [junit4:junit4] FAILURE 0.32s J0 |
> TestPerfTasksLogic.testHighlightingNoTvNoStore <<<
> > [junit4:junit4]    > Throwable #1: java.lang.AssertionError
> > [junit4:junit4]    >    at
> __randomizedtesting.SeedInfo.seed([900F08B0BE490539:2B1EF047A6586966
> ]:0)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWr
> iter.java:73)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
> > [junit4:junit4]    >    at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
> > [junit4:junit4]    >    at
> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.fi
> nish(MemoryPostingsFormat.java:271)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTerm
> sWriterPerField.java:553)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.j
> ava:85)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWrit
> erPerThread.java:488)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:4
> 22)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWrit
> er.java:559)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1619)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1595)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.ForceMergeTask.doLogic(Force
> MergeTask.java:41)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:143)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
> kSequence.java:197)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
> uence.java:138)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:143)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.jav
> a:301)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:
> 77)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(Bench
> markTestCase.java:83)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testHighlightingNo
> TvNoStore(TestPerfTasksLogic.java:266)
> > [junit4:junit4]    >    at
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > [junit4:junit4]    >    at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
> ava:88)
> > [junit4:junit4]    >    at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
> sorImpl.java:55)
> > [junit4:junit4]    >    at java.lang.reflect.Method.invoke(Method.java:613)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize
> dRunner.java:1559)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Rando
> mizedRunner.java:79)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando
> mizedRunner.java:737)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando
> mizedRunner.java:773)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando
> mizedRunner.java:787)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule
> SetupTeardownChained.java:50)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCa
> cheSanity.java:51)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
> readAndTestName.java:49)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask
> (ThreadLeakControl.java:782)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadL
> eakControl.java:442)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran
> domizedRunner.java:746)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Rando
> mizedRunner.java:648)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Rando
> mizedRunner.java:682)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Rando
> mizedRunner.java:693)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreCl
> assName.java:42)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAss
> ertionsRequired.java:43)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnore
> TestSuites.java:55)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> > [junit4:junit4]    >    at java.lang.Thread.run(Thread.java:780)
> > [junit4:junit4]   2> NOTE: reproduce with: ant test  -
> Dtestcase=TestPerfTasksLogic -Dtests.method=testIndexWriterSettings -
> Dtests.seed=900F08B0BE490539 -Dtests.multiplier=3 -Dtests.slow=true -
> Dtests.locale=sq_AL -Dtests.timezone=Europe/Luxembourg -
> Dtests.file.encoding=ISO-8859-1
> > [junit4:junit4] FAILURE 0.04s J0 |
> TestPerfTasksLogic.testIndexWriterSettings <<<
> > [junit4:junit4]    > Throwable #1: java.lang.AssertionError
> > [junit4:junit4]    >    at
> __randomizedtesting.SeedInfo.seed([900F08B0BE490539:A8E67B1D32305055
> ]:0)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWr
> iter.java:73)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
> > [junit4:junit4]    >    at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
> > [junit4:junit4]    >    at
> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.fi
> nish(MemoryPostingsFormat.java:271)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTerm
> sWriterPerField.java:553)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.j
> ava:85)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWrit
> erPerThread.java:488)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:4
> 22)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocumentsWriter.postUpdate(DocumentsWriter.ja
> va:316)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWr
> iter.java:389)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:14
> 58)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1133)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1114)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.AddDocTask.doLogic(AddDocTas
> k.java:70)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:132)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
> kSequence.java:197)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
> uence.java:138)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:143)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
> kSequence.java:197)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
> uence.java:138)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:143)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.jav
> a:301)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:
> 77)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(Bench
> markTestCase.java:83)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testIndexWriterSe
> ttings(TestPerfTasksLogic.java:752)
> > [junit4:junit4]    >    at
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > [junit4:junit4]    >    at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
> ava:88)
> > [junit4:junit4]    >    at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
> sorImpl.java:55)
> > [junit4:junit4]    >    at java.lang.reflect.Method.invoke(Method.java:613)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize
> dRunner.java:1559)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Rando
> mizedRunner.java:79)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando
> mizedRunner.java:737)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando
> mizedRunner.java:773)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando
> mizedRunner.java:787)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule
> SetupTeardownChained.java:50)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCa
> cheSanity.java:51)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
> readAndTestName.java:49)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask
> (ThreadLeakControl.java:782)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadL
> eakControl.java:442)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran
> domizedRunner.java:746)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Rando
> mizedRunner.java:648)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Rando
> mizedRunner.java:682)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Rando
> mizedRunner.java:693)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreCl
> assName.java:42)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAss
> ertionsRequired.java:43)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnore
> TestSuites.java:55)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> > [junit4:junit4]    >    at java.lang.Thread.run(Thread.java:780)
> > [junit4:junit4]   1> ------------> starting task: Seq
> > [junit4:junit4]   2> NOTE: reproduce with: ant test  -
> Dtestcase=TestPerfTasksLogic -Dtests.method=testIndexingWithFacets -
> Dtests.seed=900F08B0BE490539 -Dtests.multiplier=3 -Dtests.slow=true -
> Dtests.locale=sq_AL -Dtests.timezone=Europe/Luxembourg -
> Dtests.file.encoding=ISO-8859-1
> > [junit4:junit4] FAILURE 0.71s J0 |
> TestPerfTasksLogic.testIndexingWithFacets <<<
> > [junit4:junit4]    > Throwable #1: java.lang.AssertionError
> > [junit4:junit4]    >    at
> __randomizedtesting.SeedInfo.seed([900F08B0BE490539:B1ADCFFDAC233B
> D9]:0)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWr
> iter.java:73)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
> > [junit4:junit4]    >    at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
> > [junit4:junit4]    >    at
> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.fi
> nish(MemoryPostingsFormat.java:271)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTerm
> sWriterPerField.java:553)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.j
> ava:85)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWrit
> erPerThread.java:488)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:4
> 22)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWrit
> er.java:559)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:913)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.IndexWriter.close(IndexWriter.java:868)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.CloseIndexTask.doLogic(CloseIn
> dexTask.java:48)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:143)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
> kSequence.java:197)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
> uence.java:138)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:143)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.jav
> a:301)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:
> 77)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(Bench
> markTestCase.java:83)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testIndexingWithF
> acets(TestPerfTasksLogic.java:794)
> > [junit4:junit4]    >    at
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > [junit4:junit4]    >    at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
> ava:88)
> > [junit4:junit4]    >    at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
> sorImpl.java:55)
> > [junit4:junit4]    >    at java.lang.reflect.Method.invoke(Method.java:613)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize
> dRunner.java:1559)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Rando
> mizedRunner.java:79)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando
> mizedRunner.java:737)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando
> mizedRunner.java:773)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando
> mizedRunner.java:787)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule
> SetupTeardownChained.java:50)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCa
> cheSanity.java:51)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
> readAndTestName.java:49)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask
> (ThreadLeakControl.java:782)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadL
> eakControl.java:442)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran
> domizedRunner.java:746)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Rando
> mizedRunner.java:648)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Rando
> mizedRunner.java:682)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Rando
> mizedRunner.java:693)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreCl
> assName.java:42)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAss
> ertionsRequired.java:43)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnore
> TestSuites.java:55)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> > [junit4:junit4]    >    at java.lang.Thread.run(Thread.java:780)
> > [junit4:junit4]   1> ------------> starting task: Seq
> > [junit4:junit4]   2> NOTE: reproduce with: ant test  -
> Dtestcase=TestPerfTasksLogic -Dtests.method=testTimedSearchTask -
> Dtests.seed=900F08B0BE490539 -Dtests.multiplier=3 -Dtests.slow=true -
> Dtests.locale=sq_AL -Dtests.timezone=Europe/Luxembourg -
> Dtests.file.encoding=ISO-8859-1
> > [junit4:junit4] FAILURE 0.07s J0 | TestPerfTasksLogic.testTimedSearchTask
> <<<
> > [junit4:junit4]    > Throwable #1: java.lang.AssertionError
> > [junit4:junit4]    >    at
> __randomizedtesting.SeedInfo.seed([900F08B0BE490539:652B526DF64A34D
> 3]:0)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWr
> iter.java:73)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
> > [junit4:junit4]    >    at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
> > [junit4:junit4]    >    at
> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.fi
> nish(MemoryPostingsFormat.java:271)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTerm
> sWriterPerField.java:553)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.j
> ava:85)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWrit
> erPerThread.java:488)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:4
> 22)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWrit
> er.java:559)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1619)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1595)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.ForceMergeTask.doLogic(Force
> MergeTask.java:41)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:143)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
> kSequence.java:197)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
> uence.java:138)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:143)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.jav
> a:301)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:
> 77)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(Bench
> markTestCase.java:83)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testTimedSearchT
> ask(TestPerfTasksLogic.java:130)
> > [junit4:junit4]    >    at
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > [junit4:junit4]    >    at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
> ava:88)
> > [junit4:junit4]    >    at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
> sorImpl.java:55)
> > [junit4:junit4]    >    at java.lang.reflect.Method.invoke(Method.java:613)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize
> dRunner.java:1559)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Rando
> mizedRunner.java:79)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando
> mizedRunner.java:737)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando
> mizedRunner.java:773)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando
> mizedRunner.java:787)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule
> SetupTeardownChained.java:50)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCa
> cheSanity.java:51)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
> readAndTestName.java:49)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask
> (ThreadLeakControl.java:782)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadL
> eakControl.java:442)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran
> domizedRunner.java:746)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Rando
> mizedRunner.java:648)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Rando
> mizedRunner.java:682)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Rando
> mizedRunner.java:693)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreCl
> assName.java:42)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAss
> ertionsRequired.java:43)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnore
> TestSuites.java:55)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> > [junit4:junit4]    >    at java.lang.Thread.run(Thread.java:780)
> > [junit4:junit4]   1> Changed Locale to: root locale
> > [junit4:junit4]   1> Changed Analyzer to:
> org.apache.lucene.collation.CollationKeyAnalyzer()
> > [junit4:junit4]   1>
> > [junit4:junit4]   1> --> Round 0-->1
> > [junit4:junit4]   1>
> > [junit4:junit4]   1> Changed Locale to: de
> > [junit4:junit4]   1> Changed Analyzer to:
> org.apache.lucene.collation.CollationKeyAnalyzer(de)
> > [junit4:junit4]   1>
> > [junit4:junit4]   1> --> Round 0-->1
> > [junit4:junit4]   1>
> > [junit4:junit4]   1> Changed Locale to: en_US
> > [junit4:junit4]   1> Changed Analyzer to:
> org.apache.lucene.collation.CollationKeyAnalyzer(en_US)
> > [junit4:junit4]   1>
> > [junit4:junit4]   1> --> Round 0-->1
> > [junit4:junit4]   1>
> > [junit4:junit4]   1> Changed Locale to: no_NO_NY
> > [junit4:junit4]   1> Changed Analyzer to:
> org.apache.lucene.collation.CollationKeyAnalyzer(no_NO_NY)
> > [junit4:junit4]   1>
> > [junit4:junit4]   1> --> Round 0-->1
> > [junit4:junit4]   1>
> > [junit4:junit4]   1> ------------> starting task: Seq
> > [junit4:junit4]   1> ------------> starting task: Rounds
> > [junit4:junit4]   2> NOTE: reproduce with: ant test  -
> Dtestcase=TestPerfTasksLogic -Dtests.method=testDisableCounting -
> Dtests.seed=900F08B0BE490539 -Dtests.multiplier=3 -Dtests.slow=true -
> Dtests.locale=sq_AL -Dtests.timezone=Europe/Luxembourg -
> Dtests.file.encoding=ISO-8859-1
> > [junit4:junit4] FAILURE 0.05s J0 | TestPerfTasksLogic.testDisableCounting
> <<<
> > [junit4:junit4]    > Throwable #1: java.lang.AssertionError
> > [junit4:junit4]    >    at
> __randomizedtesting.SeedInfo.seed([900F08B0BE490539:907019F611C3328B
> ]:0)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWr
> iter.java:73)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
> > [junit4:junit4]    >    at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
> > [junit4:junit4]    >    at
> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.fi
> nish(MemoryPostingsFormat.java:271)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTerm
> sWriterPerField.java:553)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.j
> ava:85)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWrit
> erPerThread.java:488)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:4
> 22)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWrit
> er.java:559)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:913)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.IndexWriter.close(IndexWriter.java:868)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.CloseIndexTask.doLogic(CloseIn
> dexTask.java:48)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:143)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
> kSequence.java:197)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
> uence.java:138)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:143)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
> kSequence.java:197)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
> uence.java:138)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:143)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.jav
> a:301)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:
> 77)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(Bench
> markTestCase.java:83)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.doTestDisableCou
> nting(TestPerfTasksLogic.java:860)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testDisableCounti
> ng(TestPerfTasksLogic.java:851)
> > [junit4:junit4]    >    at
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > [junit4:junit4]    >    at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
> ava:88)
> > [junit4:junit4]    >    at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
> sorImpl.java:55)
> > [junit4:junit4]    >    at java.lang.reflect.Method.invoke(Method.java:613)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize
> dRunner.java:1559)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Rando
> mizedRunner.java:79)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando
> mizedRunner.java:737)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando
> mizedRunner.java:773)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando
> mizedRunner.java:787)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule
> SetupTeardownChained.java:50)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCa
> cheSanity.java:51)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
> readAndTestName.java:49)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask
> (ThreadLeakControl.java:782)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadL
> eakControl.java:442)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran
> domizedRunner.java:746)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Rando
> mizedRunner.java:648)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Rando
> mizedRunner.java:682)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Rando
> mizedRunner.java:693)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreCl
> assName.java:42)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAss
> ertionsRequired.java:43)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnore
> TestSuites.java:55)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> > [junit4:junit4]    >    at java.lang.Thread.run(Thread.java:780)
> > [junit4:junit4]   1> ------------> starting task: Seq
> > [junit4:junit4]   2> NOTE: reproduce with: ant test  -
> Dtestcase=TestPerfTasksLogic -Dtests.method=testReadTokens -
> Dtests.seed=900F08B0BE490539 -Dtests.multiplier=3 -Dtests.slow=true -
> Dtests.locale=sq_AL -Dtests.timezone=Europe/Luxembourg -
> Dtests.file.encoding=ISO-8859-1
> > [junit4:junit4] FAILURE 0.04s J0 | TestPerfTasksLogic.testReadTokens <<<
> > [junit4:junit4]    > Throwable #1: java.lang.AssertionError
> > [junit4:junit4]    >    at
> __randomizedtesting.SeedInfo.seed([900F08B0BE490539:47551770DF1E00E6
> ]:0)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWr
> iter.java:73)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
> > [junit4:junit4]    >    at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
> > [junit4:junit4]    >    at
> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.fi
> nish(MemoryPostingsFormat.java:271)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTerm
> sWriterPerField.java:553)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.j
> ava:85)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWrit
> erPerThread.java:488)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:4
> 22)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWrit
> er.java:559)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:913)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.IndexWriter.close(IndexWriter.java:868)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.CloseIndexTask.doLogic(CloseIn
> dexTask.java:48)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:143)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
> kSequence.java:197)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
> uence.java:138)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:143)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.jav
> a:301)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:
> 77)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(Bench
> markTestCase.java:83)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testReadTokens(T
> estPerfTasksLogic.java:477)
> > [junit4:junit4]    >    at
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > [junit4:junit4]    >    at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
> ava:88)
> > [junit4:junit4]    >    at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
> sorImpl.java:55)
> > [junit4:junit4]    >    at java.lang.reflect.Method.invoke(Method.java:613)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize
> dRunner.java:1559)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Rando
> mizedRunner.java:79)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando
> mizedRunner.java:737)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando
> mizedRunner.java:773)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando
> mizedRunner.java:787)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule
> SetupTeardownChained.java:50)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCa
> cheSanity.java:51)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
> readAndTestName.java:49)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask
> (ThreadLeakControl.java:782)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadL
> eakControl.java:442)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran
> domizedRunner.java:746)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Rando
> mizedRunner.java:648)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Rando
> mizedRunner.java:682)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Rando
> mizedRunner.java:693)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreCl
> assName.java:42)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAss
> ertionsRequired.java:43)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnore
> TestSuites.java:55)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> > [junit4:junit4]    >    at java.lang.Thread.run(Thread.java:780)
> > [junit4:junit4]   1> ------------> starting task: Seq
> > [junit4:junit4]   2> NOTE: reproduce with: ant test  -
> Dtestcase=TestPerfTasksLogic -Dtests.method=testLineDocFile -
> Dtests.seed=900F08B0BE490539 -Dtests.multiplier=3 -Dtests.slow=true -
> Dtests.locale=sq_AL -Dtests.timezone=Europe/Luxembourg -
> Dtests.file.encoding=ISO-8859-1
> > [junit4:junit4] FAILURE 0.10s J0 | TestPerfTasksLogic.testLineDocFile <<<
> > [junit4:junit4]    > Throwable #1: java.lang.AssertionError
> > [junit4:junit4]    >    at
> __randomizedtesting.SeedInfo.seed([900F08B0BE490539:6698ED24DD4E654
> A]:0)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWr
> iter.java:73)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
> > [junit4:junit4]    >    at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
> > [junit4:junit4]    >    at
> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.fi
> nish(MemoryPostingsFormat.java:271)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTerm
> sWriterPerField.java:553)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.j
> ava:85)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWrit
> erPerThread.java:488)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:4
> 22)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWrit
> er.java:559)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:913)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.IndexWriter.close(IndexWriter.java:868)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.CloseIndexTask.doLogic(CloseIn
> dexTask.java:48)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:143)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(Tas
> kSequence.java:197)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSeq
> uence.java:138)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(Pe
> rfTask.java:143)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.jav
> a:301)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:
> 77)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(Bench
> markTestCase.java:83)
> > [junit4:junit4]    >    at
> org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testLineDocFile(Te
> stPerfTasksLogic.java:438)
> > [junit4:junit4]    >    at
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > [junit4:junit4]    >    at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
> ava:88)
> > [junit4:junit4]    >    at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
> sorImpl.java:55)
> > [junit4:junit4]    >    at java.lang.reflect.Method.invoke(Method.java:613)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize
> dRunner.java:1559)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Rando
> mizedRunner.java:79)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando
> mizedRunner.java:737)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando
> mizedRunner.java:773)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando
> mizedRunner.java:787)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule
> SetupTeardownChained.java:50)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCa
> cheSanity.java:51)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
> readAndTestName.java:49)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask
> (ThreadLeakControl.java:782)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadL
> eakControl.java:442)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran
> domizedRunner.java:746)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Rando
> mizedRunner.java:648)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Rando
> mizedRunner.java:682)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Rando
> mizedRunner.java:693)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreCl
> assName.java:42)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAss
> ertionsRequired.java:43)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> > [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnore
> TestSuites.java:55)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> > [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> > [junit4:junit4]    >    at java.lang.Thread.run(Thread.java:780)
> > [junit4:junit4]   2> NOTE: test params are: codec=Lucene41:
> {docdatenum=Lucene41(blocksize=128), doctitle=Lucene41(blocksize=128),
> $facets=Lucene41(blocksize=128), body=PostingsFormat(name=Memory
> doPackFST= true), docname=PostingsFormat(name=Memory doPackFST=
> false), docdate=PostingsFormat(name=Memory doPackFST= true),
> random_string=MockVariableIntBlock(baseBlockSize=96),
> docid=PostingsFormat(name=Memory doPackFST= false),
> $full_path$=MockVariableIntBlock(baseBlockSize=96),
> country=PostingsFormat(name=Memory doPackFST= true),
> sort_field=PostingsFormat(name=Memory doPackFST= false),
> doctimesecnum=PostingsFormat(name=Memory doPackFST= true),
> $payloads$=PostingsFormat(name=Memory doPackFST= false)},
> sim=DefaultSimilarity, locale=sq_AL, timezone=Europe/Luxembourg
> > [junit4:junit4]   2> NOTE: Linux 3.2.0-34-generic x86/IBM Corporation 1.7.0
> (32-bit)/cpus=8,threads=1,free=11774776,total=20250624
> > [junit4:junit4]   2> NOTE: All tests run in this JVM: [AltPackageTaskTest,
> WriteEnwikiLineDocTaskTest, TestPerfTasksLogic]
> > [junit4:junit4] Completed on J0 in 7.68s, 23 tests, 14 failures <<< FAILURES!
> >
> > [...truncated 37 lines...]
> > BUILD FAILED
> > /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:365: The
> following error occurred while executing this line:
> > /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The
> following error occurred while executing this line:
> > /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build.xml:519:
> The following error occurred while executing this line:
> > /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-
> build.xml:1703: The following error occurred while executing this line:
> > /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/module-
> build.xml:61: The following error occurred while executing this line:
> > /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-
> build.xml:1175: The following error occurred while executing this line:
> > /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-
> build.xml:839: There were test failures: 17 suites, 90 tests, 14 failures
> >
> > Total time: 60 minutes 12 seconds
> > Build step 'Invoke Ant' marked build as failure
> > Archiving artifacts
> > Recording test results
> > Description set: Java: 32bit/ibm-j9-jdk7
> > Email was triggered for: Failure
> > Sending email for trigger: Failure
> >
> >
> >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> > For additional commands, e-mail: dev-help@lucene.apache.org
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Re: [JENKINS] Lucene-Solr-4.x-Linux (32bit/ibm-j9-jdk7) - Build # 3191 - Still Failing!

Posted by Michael McCandless <lu...@mikemccandless.com>.
Can anyone reproduce this?

Mike McCandless

http://blog.mikemccandless.com

On Wed, Dec 12, 2012 at 6:18 PM, Policeman Jenkins Server
<je...@sd-datasolutions.de> wrote:
> Build: http://jenkins.sd-datasolutions.de/job/Lucene-Solr-4.x-Linux/3191/
> Java: 32bit/ibm-j9-jdk7
>
> 14 tests failed.
> REGRESSION:  org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testBGSearchTaskThreads
>
> Error Message:
>
>
> Stack Trace:
> java.lang.AssertionError
>         at __randomizedtesting.SeedInfo.seed([900F08B0BE490539:4D3ACD6C068AD49B]:0)
>         at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:73)
>         at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
>         at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
>         at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
>         at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finish(MemoryPostingsFormat.java:271)
>         at org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTermsWriterPerField.java:553)
>         at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:85)
>         at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
>         at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
>         at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
>         at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:488)
>         at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:422)
>         at org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:559)
>         at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
>         at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
>         at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1619)
>         at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1595)
>         at org.apache.lucene.benchmark.byTask.tasks.ForceMergeTask.doLogic(ForceMergeTask.java:41)
>         at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
>         at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
>         at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
>         at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
>         at org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.java:301)
>         at org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:77)
>         at org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(BenchmarkTestCase.java:83)
>         at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testBGSearchTaskThreads(TestPerfTasksLogic.java:157)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
>         at java.lang.reflect.Method.invoke(Method.java:613)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
>         at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
>         at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
>         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
>         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
>         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
>         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>         at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
>         at java.lang.Thread.run(Thread.java:780)
>
>
> REGRESSION:  org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testExhaustContentSource
>
> Error Message:
>
>
> Stack Trace:
> java.lang.AssertionError
>         at __randomizedtesting.SeedInfo.seed([900F08B0BE490539:28FE72D1146C5FA0]:0)
>         at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:73)
>         at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
>         at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
>         at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
>         at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finish(MemoryPostingsFormat.java:271)
>         at org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTermsWriterPerField.java:553)
>         at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:85)
>         at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
>         at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
>         at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
>         at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:488)
>         at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:422)
>         at org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:559)
>         at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
>         at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
>         at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1619)
>         at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1595)
>         at org.apache.lucene.benchmark.byTask.tasks.ForceMergeTask.doLogic(ForceMergeTask.java:41)
>         at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
>         at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
>         at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
>         at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
>         at org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.java:301)
>         at org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:77)
>         at org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(BenchmarkTestCase.java:83)
>         at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testExhaustContentSource(TestPerfTasksLogic.java:304)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
>         at java.lang.reflect.Method.invoke(Method.java:613)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
>         at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
>         at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
>         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
>         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
>         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
>         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>         at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
>         at java.lang.Thread.run(Thread.java:780)
>
>
> REGRESSION:  org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testExhaustedLooped
>
> Error Message:
>
>
> Stack Trace:
> java.lang.AssertionError
>         at __randomizedtesting.SeedInfo.seed([900F08B0BE490539:1AE3BB949772D23F]:0)
>         at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:73)
>         at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
>         at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
>         at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
>         at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finish(MemoryPostingsFormat.java:271)
>         at org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTermsWriterPerField.java:553)
>         at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:85)
>         at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
>         at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
>         at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
>         at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:488)
>         at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:422)
>         at org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:559)
>         at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
>         at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
>         at org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:913)
>         at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:868)
>         at org.apache.lucene.benchmark.byTask.tasks.CloseIndexTask.doLogic(CloseIndexTask.java:48)
>         at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
>         at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
>         at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
>         at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
>         at org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.java:301)
>         at org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:77)
>         at org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(BenchmarkTestCase.java:83)
>         at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testExhaustedLooped(TestPerfTasksLogic.java:583)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
>         at java.lang.reflect.Method.invoke(Method.java:613)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
>         at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
>         at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
>         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
>         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
>         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
>         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>         at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
>         at java.lang.Thread.run(Thread.java:780)
>
>
> REGRESSION:  org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testIndexAndSearchTasks
>
> Error Message:
>
>
> Stack Trace:
> java.lang.AssertionError
>         at __randomizedtesting.SeedInfo.seed([900F08B0BE490539:E3C813A59FA3EB21]:0)
>         at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:73)
>         at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
>         at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
>         at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
>         at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finish(MemoryPostingsFormat.java:271)
>         at org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTermsWriterPerField.java:553)
>         at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:85)
>         at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
>         at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
>         at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
>         at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:488)
>         at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:422)
>         at org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:559)
>         at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
>         at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
>         at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1619)
>         at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1595)
>         at org.apache.lucene.benchmark.byTask.tasks.ForceMergeTask.doLogic(ForceMergeTask.java:41)
>         at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
>         at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
>         at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
>         at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
>         at org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.java:301)
>         at org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:77)
>         at org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(BenchmarkTestCase.java:83)
>         at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testIndexAndSearchTasks(TestPerfTasksLogic.java:98)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
>         at java.lang.reflect.Method.invoke(Method.java:613)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
>         at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
>         at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
>         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
>         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
>         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
>         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>         at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
>         at java.lang.Thread.run(Thread.java:780)
>
>
> REGRESSION:  org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testCloseIndexFalse
>
> Error Message:
>
>
> Stack Trace:
> java.lang.AssertionError
>         at __randomizedtesting.SeedInfo.seed([900F08B0BE490539:66537D56A7655F69]:0)
>         at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:73)
>         at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
>         at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
>         at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
>         at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finish(MemoryPostingsFormat.java:271)
>         at org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTermsWriterPerField.java:553)
>         at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:85)
>         at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
>         at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
>         at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
>         at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:488)
>         at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:422)
>         at org.apache.lucene.index.DocumentsWriter.postUpdate(DocumentsWriter.java:316)
>         at org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:389)
>         at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1458)
>         at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1133)
>         at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1114)
>         at org.apache.lucene.benchmark.byTask.tasks.AddDocTask.doLogic(AddDocTask.java:70)
>         at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:132)
>         at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
>         at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
>         at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
>         at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
>         at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
>         at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
>         at org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.java:301)
>         at org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:77)
>         at org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(BenchmarkTestCase.java:83)
>         at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testCloseIndexFalse(TestPerfTasksLogic.java:620)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
>         at java.lang.reflect.Method.invoke(Method.java:613)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
>         at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
>         at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
>         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
>         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
>         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
>         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>         at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
>         at java.lang.Thread.run(Thread.java:780)
>
>
> REGRESSION:  org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testHighlightingTV
>
> Error Message:
>
>
> Stack Trace:
> java.lang.AssertionError
>         at __randomizedtesting.SeedInfo.seed([900F08B0BE490539:F02D2EC62156EDA0]:0)
>         at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:73)
>         at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
>         at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
>         at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
>         at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finish(MemoryPostingsFormat.java:271)
>         at org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTermsWriterPerField.java:553)
>         at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:85)
>         at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
>         at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
>         at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
>         at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:488)
>         at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:422)
>         at org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:559)
>         at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
>         at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
>         at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1619)
>         at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1595)
>         at org.apache.lucene.benchmark.byTask.tasks.ForceMergeTask.doLogic(ForceMergeTask.java:41)
>         at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
>         at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
>         at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
>         at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
>         at org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.java:301)
>         at org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:77)
>         at org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(BenchmarkTestCase.java:83)
>         at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testHighlightingTV(TestPerfTasksLogic.java:227)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
>         at java.lang.reflect.Method.invoke(Method.java:613)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
>         at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
>         at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
>         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
>         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
>         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
>         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>         at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
>         at java.lang.Thread.run(Thread.java:780)
>
>
> REGRESSION:  org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testParallelExhausted
>
> Error Message:
>
>
> Stack Trace:
> java.lang.AssertionError
>         at __randomizedtesting.SeedInfo.seed([900F08B0BE490539:D1A71DF46B968045]:0)
>         at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:73)
>         at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
>         at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
>         at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
>         at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finish(MemoryPostingsFormat.java:271)
>         at org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTermsWriterPerField.java:553)
>         at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:85)
>         at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
>         at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
>         at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
>         at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:488)
>         at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:422)
>         at org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:559)
>         at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
>         at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
>         at org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:913)
>         at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:868)
>         at org.apache.lucene.benchmark.byTask.tasks.CloseIndexTask.doLogic(CloseIndexTask.java:48)
>         at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
>         at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
>         at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
>         at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
>         at org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.java:301)
>         at org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:77)
>         at org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(BenchmarkTestCase.java:83)
>         at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testParallelExhausted(TestPerfTasksLogic.java:546)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
>         at java.lang.reflect.Method.invoke(Method.java:613)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
>         at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
>         at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
>         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
>         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
>         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
>         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>         at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
>         at java.lang.Thread.run(Thread.java:780)
>
>
> REGRESSION:  org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testHighlightingNoTvNoStore
>
> Error Message:
>
>
> Stack Trace:
> java.lang.AssertionError
>         at __randomizedtesting.SeedInfo.seed([900F08B0BE490539:2B1EF047A6586966]:0)
>         at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:73)
>         at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
>         at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
>         at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
>         at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finish(MemoryPostingsFormat.java:271)
>         at org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTermsWriterPerField.java:553)
>         at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:85)
>         at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
>         at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
>         at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
>         at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:488)
>         at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:422)
>         at org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:559)
>         at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
>         at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
>         at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1619)
>         at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1595)
>         at org.apache.lucene.benchmark.byTask.tasks.ForceMergeTask.doLogic(ForceMergeTask.java:41)
>         at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
>         at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
>         at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
>         at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
>         at org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.java:301)
>         at org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:77)
>         at org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(BenchmarkTestCase.java:83)
>         at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testHighlightingNoTvNoStore(TestPerfTasksLogic.java:266)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
>         at java.lang.reflect.Method.invoke(Method.java:613)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
>         at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
>         at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
>         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
>         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
>         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
>         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>         at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
>         at java.lang.Thread.run(Thread.java:780)
>
>
> REGRESSION:  org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testIndexWriterSettings
>
> Error Message:
>
>
> Stack Trace:
> java.lang.AssertionError
>         at __randomizedtesting.SeedInfo.seed([900F08B0BE490539:A8E67B1D32305055]:0)
>         at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:73)
>         at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
>         at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
>         at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
>         at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finish(MemoryPostingsFormat.java:271)
>         at org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTermsWriterPerField.java:553)
>         at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:85)
>         at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
>         at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
>         at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
>         at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:488)
>         at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:422)
>         at org.apache.lucene.index.DocumentsWriter.postUpdate(DocumentsWriter.java:316)
>         at org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:389)
>         at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1458)
>         at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1133)
>         at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1114)
>         at org.apache.lucene.benchmark.byTask.tasks.AddDocTask.doLogic(AddDocTask.java:70)
>         at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:132)
>         at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
>         at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
>         at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
>         at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
>         at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
>         at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
>         at org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.java:301)
>         at org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:77)
>         at org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(BenchmarkTestCase.java:83)
>         at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testIndexWriterSettings(TestPerfTasksLogic.java:752)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
>         at java.lang.reflect.Method.invoke(Method.java:613)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
>         at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
>         at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
>         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
>         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
>         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
>         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>         at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
>         at java.lang.Thread.run(Thread.java:780)
>
>
> REGRESSION:  org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testIndexingWithFacets
>
> Error Message:
>
>
> Stack Trace:
> java.lang.AssertionError
>         at __randomizedtesting.SeedInfo.seed([900F08B0BE490539:B1ADCFFDAC233BD9]:0)
>         at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:73)
>         at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
>         at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
>         at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
>         at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finish(MemoryPostingsFormat.java:271)
>         at org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTermsWriterPerField.java:553)
>         at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:85)
>         at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
>         at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
>         at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
>         at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:488)
>         at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:422)
>         at org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:559)
>         at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
>         at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
>         at org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:913)
>         at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:868)
>         at org.apache.lucene.benchmark.byTask.tasks.CloseIndexTask.doLogic(CloseIndexTask.java:48)
>         at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
>         at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
>         at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
>         at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
>         at org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.java:301)
>         at org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:77)
>         at org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(BenchmarkTestCase.java:83)
>         at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testIndexingWithFacets(TestPerfTasksLogic.java:794)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
>         at java.lang.reflect.Method.invoke(Method.java:613)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
>         at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
>         at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
>         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
>         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
>         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
>         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>         at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
>         at java.lang.Thread.run(Thread.java:780)
>
>
> REGRESSION:  org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testTimedSearchTask
>
> Error Message:
>
>
> Stack Trace:
> java.lang.AssertionError
>         at __randomizedtesting.SeedInfo.seed([900F08B0BE490539:652B526DF64A34D3]:0)
>         at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:73)
>         at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
>         at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
>         at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
>         at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finish(MemoryPostingsFormat.java:271)
>         at org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTermsWriterPerField.java:553)
>         at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:85)
>         at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
>         at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
>         at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
>         at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:488)
>         at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:422)
>         at org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:559)
>         at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
>         at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
>         at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1619)
>         at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1595)
>         at org.apache.lucene.benchmark.byTask.tasks.ForceMergeTask.doLogic(ForceMergeTask.java:41)
>         at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
>         at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
>         at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
>         at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
>         at org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.java:301)
>         at org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:77)
>         at org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(BenchmarkTestCase.java:83)
>         at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testTimedSearchTask(TestPerfTasksLogic.java:130)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
>         at java.lang.reflect.Method.invoke(Method.java:613)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
>         at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
>         at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
>         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
>         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
>         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
>         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>         at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
>         at java.lang.Thread.run(Thread.java:780)
>
>
> REGRESSION:  org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testDisableCounting
>
> Error Message:
>
>
> Stack Trace:
> java.lang.AssertionError
>         at __randomizedtesting.SeedInfo.seed([900F08B0BE490539:907019F611C3328B]:0)
>         at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:73)
>         at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
>         at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
>         at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
>         at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finish(MemoryPostingsFormat.java:271)
>         at org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTermsWriterPerField.java:553)
>         at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:85)
>         at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
>         at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
>         at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
>         at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:488)
>         at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:422)
>         at org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:559)
>         at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
>         at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
>         at org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:913)
>         at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:868)
>         at org.apache.lucene.benchmark.byTask.tasks.CloseIndexTask.doLogic(CloseIndexTask.java:48)
>         at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
>         at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
>         at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
>         at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
>         at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
>         at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
>         at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
>         at org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.java:301)
>         at org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:77)
>         at org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(BenchmarkTestCase.java:83)
>         at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.doTestDisableCounting(TestPerfTasksLogic.java:860)
>         at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testDisableCounting(TestPerfTasksLogic.java:851)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
>         at java.lang.reflect.Method.invoke(Method.java:613)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
>         at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
>         at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
>         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
>         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
>         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
>         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>         at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
>         at java.lang.Thread.run(Thread.java:780)
>
>
> REGRESSION:  org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testReadTokens
>
> Error Message:
>
>
> Stack Trace:
> java.lang.AssertionError
>         at __randomizedtesting.SeedInfo.seed([900F08B0BE490539:47551770DF1E00E6]:0)
>         at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:73)
>         at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
>         at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
>         at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
>         at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finish(MemoryPostingsFormat.java:271)
>         at org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTermsWriterPerField.java:553)
>         at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:85)
>         at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
>         at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
>         at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
>         at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:488)
>         at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:422)
>         at org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:559)
>         at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
>         at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
>         at org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:913)
>         at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:868)
>         at org.apache.lucene.benchmark.byTask.tasks.CloseIndexTask.doLogic(CloseIndexTask.java:48)
>         at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
>         at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
>         at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
>         at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
>         at org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.java:301)
>         at org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:77)
>         at org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(BenchmarkTestCase.java:83)
>         at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testReadTokens(TestPerfTasksLogic.java:477)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
>         at java.lang.reflect.Method.invoke(Method.java:613)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
>         at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
>         at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
>         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
>         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
>         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
>         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>         at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
>         at java.lang.Thread.run(Thread.java:780)
>
>
> REGRESSION:  org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testLineDocFile
>
> Error Message:
>
>
> Stack Trace:
> java.lang.AssertionError
>         at __randomizedtesting.SeedInfo.seed([900F08B0BE490539:6698ED24DD4E654A]:0)
>         at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:73)
>         at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
>         at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
>         at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
>         at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finish(MemoryPostingsFormat.java:271)
>         at org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTermsWriterPerField.java:553)
>         at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:85)
>         at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
>         at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
>         at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
>         at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:488)
>         at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:422)
>         at org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:559)
>         at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
>         at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
>         at org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:913)
>         at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:868)
>         at org.apache.lucene.benchmark.byTask.tasks.CloseIndexTask.doLogic(CloseIndexTask.java:48)
>         at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
>         at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
>         at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
>         at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
>         at org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.java:301)
>         at org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:77)
>         at org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(BenchmarkTestCase.java:83)
>         at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testLineDocFile(TestPerfTasksLogic.java:438)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
>         at java.lang.reflect.Method.invoke(Method.java:613)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
>         at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
>         at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
>         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
>         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
>         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
>         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>         at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
>         at java.lang.Thread.run(Thread.java:780)
>
>
>
>
> Build Log:
> [...truncated 6122 lines...]
> [junit4:junit4] Suite: org.apache.lucene.benchmark.byTask.TestPerfTasksLogic
> [junit4:junit4]   1> ------------> starting task: Seq
> [junit4:junit4]   1> ------------> starting task: Seq
> [junit4:junit4]   1> ------------> starting task: Seq
> [junit4:junit4]   1> ------------> starting task: Seq
> [junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestPerfTasksLogic -Dtests.method=testBGSearchTaskThreads -Dtests.seed=900F08B0BE490539 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sq_AL -Dtests.timezone=Europe/Luxembourg -Dtests.file.encoding=ISO-8859-1
> [junit4:junit4] FAILURE 0.63s J0 | TestPerfTasksLogic.testBGSearchTaskThreads <<<
> [junit4:junit4]    > Throwable #1: java.lang.AssertionError
> [junit4:junit4]    >    at __randomizedtesting.SeedInfo.seed([900F08B0BE490539:4D3ACD6C068AD49B]:0)
> [junit4:junit4]    >    at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:73)
> [junit4:junit4]    >    at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
> [junit4:junit4]    >    at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
> [junit4:junit4]    >    at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
> [junit4:junit4]    >    at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finish(MemoryPostingsFormat.java:271)
> [junit4:junit4]    >    at org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTermsWriterPerField.java:553)
> [junit4:junit4]    >    at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:85)
> [junit4:junit4]    >    at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
> [junit4:junit4]    >    at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
> [junit4:junit4]    >    at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
> [junit4:junit4]    >    at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:488)
> [junit4:junit4]    >    at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:422)
> [junit4:junit4]    >    at org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:559)
> [junit4:junit4]    >    at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
> [junit4:junit4]    >    at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
> [junit4:junit4]    >    at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1619)
> [junit4:junit4]    >    at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1595)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.ForceMergeTask.doLogic(ForceMergeTask.java:41)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.java:301)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:77)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(BenchmarkTestCase.java:83)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testBGSearchTaskThreads(TestPerfTasksLogic.java:157)
> [junit4:junit4]    >    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> [junit4:junit4]    >    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
> [junit4:junit4]    >    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
> [junit4:junit4]    >    at java.lang.reflect.Method.invoke(Method.java:613)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
> [junit4:junit4]    >    at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
> [junit4:junit4]    >    at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> [junit4:junit4]    >    at java.lang.Thread.run(Thread.java:780)
> [junit4:junit4]   1> ------------> starting task: Seq
> [junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestPerfTasksLogic -Dtests.method=testExhaustContentSource -Dtests.seed=900F08B0BE490539 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sq_AL -Dtests.timezone=Europe/Luxembourg -Dtests.file.encoding=ISO-8859-1
> [junit4:junit4] FAILURE 0.05s J0 | TestPerfTasksLogic.testExhaustContentSource <<<
> [junit4:junit4]    > Throwable #1: java.lang.AssertionError
> [junit4:junit4]    >    at __randomizedtesting.SeedInfo.seed([900F08B0BE490539:28FE72D1146C5FA0]:0)
> [junit4:junit4]    >    at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:73)
> [junit4:junit4]    >    at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
> [junit4:junit4]    >    at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
> [junit4:junit4]    >    at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
> [junit4:junit4]    >    at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finish(MemoryPostingsFormat.java:271)
> [junit4:junit4]    >    at org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTermsWriterPerField.java:553)
> [junit4:junit4]    >    at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:85)
> [junit4:junit4]    >    at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
> [junit4:junit4]    >    at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
> [junit4:junit4]    >    at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
> [junit4:junit4]    >    at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:488)
> [junit4:junit4]    >    at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:422)
> [junit4:junit4]    >    at org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:559)
> [junit4:junit4]    >    at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
> [junit4:junit4]    >    at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
> [junit4:junit4]    >    at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1619)
> [junit4:junit4]    >    at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1595)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.ForceMergeTask.doLogic(ForceMergeTask.java:41)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.java:301)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:77)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(BenchmarkTestCase.java:83)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testExhaustContentSource(TestPerfTasksLogic.java:304)
> [junit4:junit4]    >    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> [junit4:junit4]    >    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
> [junit4:junit4]    >    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
> [junit4:junit4]    >    at java.lang.reflect.Method.invoke(Method.java:613)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
> [junit4:junit4]    >    at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
> [junit4:junit4]    >    at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> [junit4:junit4]    >    at java.lang.Thread.run(Thread.java:780)
> [junit4:junit4]   1> Changed Locale to: null
> [junit4:junit4]   1>
> [junit4:junit4]   1> --> Round 0-->1
> [junit4:junit4]   1>
> [junit4:junit4]   1> Changed Locale to: root locale
> [junit4:junit4]   1>
> [junit4:junit4]   1> --> Round 0-->1
> [junit4:junit4]   1>
> [junit4:junit4]   1> Changed Locale to: de
> [junit4:junit4]   1>
> [junit4:junit4]   1> --> Round 0-->1
> [junit4:junit4]   1>
> [junit4:junit4]   1> Changed Locale to: en_US
> [junit4:junit4]   1>
> [junit4:junit4]   1> --> Round 0-->1
> [junit4:junit4]   1>
> [junit4:junit4]   1> Changed Locale to: no_NO_NY
> [junit4:junit4]   1>
> [junit4:junit4]   1> --> Round 0-->1
> [junit4:junit4]   1>
> [junit4:junit4]   1> ------------> starting task: Rounds_2
> [junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestPerfTasksLogic -Dtests.method=testExhaustedLooped -Dtests.seed=900F08B0BE490539 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sq_AL -Dtests.timezone=Europe/Luxembourg -Dtests.file.encoding=ISO-8859-1
> [junit4:junit4] FAILURE 0.06s J0 | TestPerfTasksLogic.testExhaustedLooped <<<
> [junit4:junit4]    > Throwable #1: java.lang.AssertionError
> [junit4:junit4]    >    at __randomizedtesting.SeedInfo.seed([900F08B0BE490539:1AE3BB949772D23F]:0)
> [junit4:junit4]    >    at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:73)
> [junit4:junit4]    >    at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
> [junit4:junit4]    >    at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
> [junit4:junit4]    >    at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
> [junit4:junit4]    >    at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finish(MemoryPostingsFormat.java:271)
> [junit4:junit4]    >    at org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTermsWriterPerField.java:553)
> [junit4:junit4]    >    at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:85)
> [junit4:junit4]    >    at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
> [junit4:junit4]    >    at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
> [junit4:junit4]    >    at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
> [junit4:junit4]    >    at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:488)
> [junit4:junit4]    >    at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:422)
> [junit4:junit4]    >    at org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:559)
> [junit4:junit4]    >    at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
> [junit4:junit4]    >    at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
> [junit4:junit4]    >    at org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:913)
> [junit4:junit4]    >    at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:868)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.CloseIndexTask.doLogic(CloseIndexTask.java:48)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.java:301)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:77)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(BenchmarkTestCase.java:83)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testExhaustedLooped(TestPerfTasksLogic.java:583)
> [junit4:junit4]    >    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> [junit4:junit4]    >    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
> [junit4:junit4]    >    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
> [junit4:junit4]    >    at java.lang.reflect.Method.invoke(Method.java:613)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
> [junit4:junit4]    >    at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
> [junit4:junit4]    >    at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> [junit4:junit4]    >    at java.lang.Thread.run(Thread.java:780)
> [junit4:junit4]   1> ------------> starting task: Seq
> [junit4:junit4]   1> Changed Analyzer to: ShingleAnalyzerWrapper, wrapping ShingleFilter over org.apache.lucene.analysis.standard.StandardAnalyzer
> [junit4:junit4]   1> ------------> starting task: Seq
> [junit4:junit4]   1> Changed Analyzer to: ShingleAnalyzerWrapper, wrapping ShingleFilter over org.apache.lucene.analysis.standard.StandardAnalyzer
> [junit4:junit4]   1> ------------> starting task: Seq
> [junit4:junit4]   1> Changed Analyzer to: ShingleAnalyzerWrapper, wrapping ShingleFilter over org.apache.lucene.analysis.core.WhitespaceAnalyzer
> [junit4:junit4]   1> ------------> starting task: Seq
> [junit4:junit4]   1> Changed Analyzer to: ShingleAnalyzerWrapper, wrapping ShingleFilter over org.apache.lucene.analysis.core.WhitespaceAnalyzer
> [junit4:junit4]   1> ------------> starting task: Seq
> [junit4:junit4]   1>    0.16 sec --> TEST-TestPerfTasksLogic.testIndexAndSearchTasks-seed#[900F08B0BE490539] added      1000 docs
> [junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestPerfTasksLogic -Dtests.method=testIndexAndSearchTasks -Dtests.seed=900F08B0BE490539 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sq_AL -Dtests.timezone=Europe/Luxembourg -Dtests.file.encoding=ISO-8859-1
> [junit4:junit4] FAILURE 0.25s J0 | TestPerfTasksLogic.testIndexAndSearchTasks <<<
> [junit4:junit4]    > Throwable #1: java.lang.AssertionError
> [junit4:junit4]    >    at __randomizedtesting.SeedInfo.seed([900F08B0BE490539:E3C813A59FA3EB21]:0)
> [junit4:junit4]    >    at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:73)
> [junit4:junit4]    >    at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
> [junit4:junit4]    >    at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
> [junit4:junit4]    >    at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
> [junit4:junit4]    >    at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finish(MemoryPostingsFormat.java:271)
> [junit4:junit4]    >    at org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTermsWriterPerField.java:553)
> [junit4:junit4]    >    at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:85)
> [junit4:junit4]    >    at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
> [junit4:junit4]    >    at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
> [junit4:junit4]    >    at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
> [junit4:junit4]    >    at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:488)
> [junit4:junit4]    >    at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:422)
> [junit4:junit4]    >    at org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:559)
> [junit4:junit4]    >    at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
> [junit4:junit4]    >    at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
> [junit4:junit4]    >    at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1619)
> [junit4:junit4]    >    at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1595)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.ForceMergeTask.doLogic(ForceMergeTask.java:41)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.java:301)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:77)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(BenchmarkTestCase.java:83)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testIndexAndSearchTasks(TestPerfTasksLogic.java:98)
> [junit4:junit4]    >    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> [junit4:junit4]    >    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
> [junit4:junit4]    >    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
> [junit4:junit4]    >    at java.lang.reflect.Method.invoke(Method.java:613)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
> [junit4:junit4]    >    at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
> [junit4:junit4]    >    at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> [junit4:junit4]    >    at java.lang.Thread.run(Thread.java:780)
> [junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestPerfTasksLogic -Dtests.method=testCloseIndexFalse -Dtests.seed=900F08B0BE490539 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sq_AL -Dtests.timezone=Europe/Luxembourg -Dtests.file.encoding=ISO-8859-1
> [junit4:junit4] FAILURE 0.07s J0 | TestPerfTasksLogic.testCloseIndexFalse <<<
> [junit4:junit4]    > Throwable #1: java.lang.AssertionError
> [junit4:junit4]    >    at __randomizedtesting.SeedInfo.seed([900F08B0BE490539:66537D56A7655F69]:0)
> [junit4:junit4]    >    at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:73)
> [junit4:junit4]    >    at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
> [junit4:junit4]    >    at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
> [junit4:junit4]    >    at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
> [junit4:junit4]    >    at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finish(MemoryPostingsFormat.java:271)
> [junit4:junit4]    >    at org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTermsWriterPerField.java:553)
> [junit4:junit4]    >    at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:85)
> [junit4:junit4]    >    at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
> [junit4:junit4]    >    at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
> [junit4:junit4]    >    at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
> [junit4:junit4]    >    at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:488)
> [junit4:junit4]    >    at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:422)
> [junit4:junit4]    >    at org.apache.lucene.index.DocumentsWriter.postUpdate(DocumentsWriter.java:316)
> [junit4:junit4]    >    at org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:389)
> [junit4:junit4]    >    at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1458)
> [junit4:junit4]    >    at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1133)
> [junit4:junit4]    >    at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1114)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.AddDocTask.doLogic(AddDocTask.java:70)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:132)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.java:301)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:77)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(BenchmarkTestCase.java:83)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testCloseIndexFalse(TestPerfTasksLogic.java:620)
> [junit4:junit4]    >    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> [junit4:junit4]    >    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
> [junit4:junit4]    >    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
> [junit4:junit4]    >    at java.lang.reflect.Method.invoke(Method.java:613)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
> [junit4:junit4]    >    at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
> [junit4:junit4]    >    at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> [junit4:junit4]    >    at java.lang.Thread.run(Thread.java:780)
> [junit4:junit4]   1> ------------> starting task: Seq
> [junit4:junit4]   1>    0.69 sec --> TEST-TestPerfTasksLogic.testHighlightingTV-seed#[900F08B0BE490539] added      1000 docs
> [junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestPerfTasksLogic -Dtests.method=testHighlightingTV -Dtests.seed=900F08B0BE490539 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sq_AL -Dtests.timezone=Europe/Luxembourg -Dtests.file.encoding=ISO-8859-1
> [junit4:junit4] FAILURE 0.89s J0 | TestPerfTasksLogic.testHighlightingTV <<<
> [junit4:junit4]    > Throwable #1: java.lang.AssertionError
> [junit4:junit4]    >    at __randomizedtesting.SeedInfo.seed([900F08B0BE490539:F02D2EC62156EDA0]:0)
> [junit4:junit4]    >    at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:73)
> [junit4:junit4]    >    at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
> [junit4:junit4]    >    at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
> [junit4:junit4]    >    at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
> [junit4:junit4]    >    at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finish(MemoryPostingsFormat.java:271)
> [junit4:junit4]    >    at org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTermsWriterPerField.java:553)
> [junit4:junit4]    >    at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:85)
> [junit4:junit4]    >    at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
> [junit4:junit4]    >    at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
> [junit4:junit4]    >    at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
> [junit4:junit4]    >    at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:488)
> [junit4:junit4]    >    at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:422)
> [junit4:junit4]    >    at org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:559)
> [junit4:junit4]    >    at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
> [junit4:junit4]    >    at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
> [junit4:junit4]    >    at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1619)
> [junit4:junit4]    >    at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1595)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.ForceMergeTask.doLogic(ForceMergeTask.java:41)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.java:301)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:77)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(BenchmarkTestCase.java:83)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testHighlightingTV(TestPerfTasksLogic.java:227)
> [junit4:junit4]    >    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> [junit4:junit4]    >    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
> [junit4:junit4]    >    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
> [junit4:junit4]    >    at java.lang.reflect.Method.invoke(Method.java:613)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
> [junit4:junit4]    >    at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
> [junit4:junit4]    >    at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> [junit4:junit4]    >    at java.lang.Thread.run(Thread.java:780)
> [junit4:junit4]   1> ------------> starting task: Seq
> [junit4:junit4]   1> ------------> starting task: CreateIndex
> [junit4:junit4]   1> ------------> starting task: Seq_Exhaust
> [junit4:junit4]   1> ------------> starting task: Seq_Exhaust
> [junit4:junit4]   1> ------------> starting task: WaitForMerges
> [junit4:junit4]   1> ------------> starting task: CloseIndex
> [junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestPerfTasksLogic -Dtests.method=testParallelExhausted -Dtests.seed=900F08B0BE490539 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sq_AL -Dtests.timezone=Europe/Luxembourg -Dtests.file.encoding=ISO-8859-1
> [junit4:junit4] FAILURE 0.10s J0 | TestPerfTasksLogic.testParallelExhausted <<<
> [junit4:junit4]    > Throwable #1: java.lang.AssertionError
> [junit4:junit4]    >    at __randomizedtesting.SeedInfo.seed([900F08B0BE490539:D1A71DF46B968045]:0)
> [junit4:junit4]    >    at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:73)
> [junit4:junit4]    >    at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
> [junit4:junit4]    >    at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
> [junit4:junit4]    >    at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
> [junit4:junit4]    >    at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finish(MemoryPostingsFormat.java:271)
> [junit4:junit4]    >    at org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTermsWriterPerField.java:553)
> [junit4:junit4]    >    at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:85)
> [junit4:junit4]    >    at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
> [junit4:junit4]    >    at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
> [junit4:junit4]    >    at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
> [junit4:junit4]    >    at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:488)
> [junit4:junit4]    >    at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:422)
> [junit4:junit4]    >    at org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:559)
> [junit4:junit4]    >    at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
> [junit4:junit4]    >    at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
> [junit4:junit4]    >    at org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:913)
> [junit4:junit4]    >    at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:868)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.CloseIndexTask.doLogic(CloseIndexTask.java:48)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.java:301)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:77)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(BenchmarkTestCase.java:83)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testParallelExhausted(TestPerfTasksLogic.java:546)
> [junit4:junit4]    >    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> [junit4:junit4]    >    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
> [junit4:junit4]    >    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
> [junit4:junit4]    >    at java.lang.reflect.Method.invoke(Method.java:613)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
> [junit4:junit4]    >    at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
> [junit4:junit4]    >    at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> [junit4:junit4]    >    at java.lang.Thread.run(Thread.java:780)
> [junit4:junit4]   1> ------------> starting task: Seq
> [junit4:junit4]   1>    0.22 sec --> TEST-TestPerfTasksLogic.testHighlightingNoTvNoStore-seed#[900F08B0BE490539] added      1000 docs
> [junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestPerfTasksLogic -Dtests.method=testHighlightingNoTvNoStore -Dtests.seed=900F08B0BE490539 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sq_AL -Dtests.timezone=Europe/Luxembourg -Dtests.file.encoding=ISO-8859-1
> [junit4:junit4] FAILURE 0.32s J0 | TestPerfTasksLogic.testHighlightingNoTvNoStore <<<
> [junit4:junit4]    > Throwable #1: java.lang.AssertionError
> [junit4:junit4]    >    at __randomizedtesting.SeedInfo.seed([900F08B0BE490539:2B1EF047A6586966]:0)
> [junit4:junit4]    >    at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:73)
> [junit4:junit4]    >    at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
> [junit4:junit4]    >    at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
> [junit4:junit4]    >    at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
> [junit4:junit4]    >    at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finish(MemoryPostingsFormat.java:271)
> [junit4:junit4]    >    at org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTermsWriterPerField.java:553)
> [junit4:junit4]    >    at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:85)
> [junit4:junit4]    >    at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
> [junit4:junit4]    >    at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
> [junit4:junit4]    >    at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
> [junit4:junit4]    >    at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:488)
> [junit4:junit4]    >    at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:422)
> [junit4:junit4]    >    at org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:559)
> [junit4:junit4]    >    at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
> [junit4:junit4]    >    at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
> [junit4:junit4]    >    at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1619)
> [junit4:junit4]    >    at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1595)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.ForceMergeTask.doLogic(ForceMergeTask.java:41)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.java:301)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:77)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(BenchmarkTestCase.java:83)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testHighlightingNoTvNoStore(TestPerfTasksLogic.java:266)
> [junit4:junit4]    >    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> [junit4:junit4]    >    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
> [junit4:junit4]    >    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
> [junit4:junit4]    >    at java.lang.reflect.Method.invoke(Method.java:613)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
> [junit4:junit4]    >    at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
> [junit4:junit4]    >    at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> [junit4:junit4]    >    at java.lang.Thread.run(Thread.java:780)
> [junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestPerfTasksLogic -Dtests.method=testIndexWriterSettings -Dtests.seed=900F08B0BE490539 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sq_AL -Dtests.timezone=Europe/Luxembourg -Dtests.file.encoding=ISO-8859-1
> [junit4:junit4] FAILURE 0.04s J0 | TestPerfTasksLogic.testIndexWriterSettings <<<
> [junit4:junit4]    > Throwable #1: java.lang.AssertionError
> [junit4:junit4]    >    at __randomizedtesting.SeedInfo.seed([900F08B0BE490539:A8E67B1D32305055]:0)
> [junit4:junit4]    >    at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:73)
> [junit4:junit4]    >    at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
> [junit4:junit4]    >    at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
> [junit4:junit4]    >    at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
> [junit4:junit4]    >    at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finish(MemoryPostingsFormat.java:271)
> [junit4:junit4]    >    at org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTermsWriterPerField.java:553)
> [junit4:junit4]    >    at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:85)
> [junit4:junit4]    >    at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
> [junit4:junit4]    >    at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
> [junit4:junit4]    >    at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
> [junit4:junit4]    >    at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:488)
> [junit4:junit4]    >    at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:422)
> [junit4:junit4]    >    at org.apache.lucene.index.DocumentsWriter.postUpdate(DocumentsWriter.java:316)
> [junit4:junit4]    >    at org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:389)
> [junit4:junit4]    >    at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1458)
> [junit4:junit4]    >    at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1133)
> [junit4:junit4]    >    at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1114)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.AddDocTask.doLogic(AddDocTask.java:70)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:132)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.java:301)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:77)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(BenchmarkTestCase.java:83)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testIndexWriterSettings(TestPerfTasksLogic.java:752)
> [junit4:junit4]    >    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> [junit4:junit4]    >    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
> [junit4:junit4]    >    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
> [junit4:junit4]    >    at java.lang.reflect.Method.invoke(Method.java:613)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
> [junit4:junit4]    >    at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
> [junit4:junit4]    >    at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> [junit4:junit4]    >    at java.lang.Thread.run(Thread.java:780)
> [junit4:junit4]   1> ------------> starting task: Seq
> [junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestPerfTasksLogic -Dtests.method=testIndexingWithFacets -Dtests.seed=900F08B0BE490539 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sq_AL -Dtests.timezone=Europe/Luxembourg -Dtests.file.encoding=ISO-8859-1
> [junit4:junit4] FAILURE 0.71s J0 | TestPerfTasksLogic.testIndexingWithFacets <<<
> [junit4:junit4]    > Throwable #1: java.lang.AssertionError
> [junit4:junit4]    >    at __randomizedtesting.SeedInfo.seed([900F08B0BE490539:B1ADCFFDAC233BD9]:0)
> [junit4:junit4]    >    at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:73)
> [junit4:junit4]    >    at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
> [junit4:junit4]    >    at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
> [junit4:junit4]    >    at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
> [junit4:junit4]    >    at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finish(MemoryPostingsFormat.java:271)
> [junit4:junit4]    >    at org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTermsWriterPerField.java:553)
> [junit4:junit4]    >    at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:85)
> [junit4:junit4]    >    at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
> [junit4:junit4]    >    at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
> [junit4:junit4]    >    at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
> [junit4:junit4]    >    at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:488)
> [junit4:junit4]    >    at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:422)
> [junit4:junit4]    >    at org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:559)
> [junit4:junit4]    >    at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
> [junit4:junit4]    >    at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
> [junit4:junit4]    >    at org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:913)
> [junit4:junit4]    >    at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:868)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.CloseIndexTask.doLogic(CloseIndexTask.java:48)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.java:301)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:77)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(BenchmarkTestCase.java:83)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testIndexingWithFacets(TestPerfTasksLogic.java:794)
> [junit4:junit4]    >    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> [junit4:junit4]    >    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
> [junit4:junit4]    >    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
> [junit4:junit4]    >    at java.lang.reflect.Method.invoke(Method.java:613)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
> [junit4:junit4]    >    at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
> [junit4:junit4]    >    at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> [junit4:junit4]    >    at java.lang.Thread.run(Thread.java:780)
> [junit4:junit4]   1> ------------> starting task: Seq
> [junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestPerfTasksLogic -Dtests.method=testTimedSearchTask -Dtests.seed=900F08B0BE490539 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sq_AL -Dtests.timezone=Europe/Luxembourg -Dtests.file.encoding=ISO-8859-1
> [junit4:junit4] FAILURE 0.07s J0 | TestPerfTasksLogic.testTimedSearchTask <<<
> [junit4:junit4]    > Throwable #1: java.lang.AssertionError
> [junit4:junit4]    >    at __randomizedtesting.SeedInfo.seed([900F08B0BE490539:652B526DF64A34D3]:0)
> [junit4:junit4]    >    at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:73)
> [junit4:junit4]    >    at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
> [junit4:junit4]    >    at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
> [junit4:junit4]    >    at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
> [junit4:junit4]    >    at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finish(MemoryPostingsFormat.java:271)
> [junit4:junit4]    >    at org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTermsWriterPerField.java:553)
> [junit4:junit4]    >    at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:85)
> [junit4:junit4]    >    at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
> [junit4:junit4]    >    at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
> [junit4:junit4]    >    at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
> [junit4:junit4]    >    at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:488)
> [junit4:junit4]    >    at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:422)
> [junit4:junit4]    >    at org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:559)
> [junit4:junit4]    >    at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
> [junit4:junit4]    >    at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
> [junit4:junit4]    >    at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1619)
> [junit4:junit4]    >    at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1595)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.ForceMergeTask.doLogic(ForceMergeTask.java:41)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.java:301)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:77)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(BenchmarkTestCase.java:83)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testTimedSearchTask(TestPerfTasksLogic.java:130)
> [junit4:junit4]    >    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> [junit4:junit4]    >    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
> [junit4:junit4]    >    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
> [junit4:junit4]    >    at java.lang.reflect.Method.invoke(Method.java:613)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
> [junit4:junit4]    >    at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
> [junit4:junit4]    >    at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> [junit4:junit4]    >    at java.lang.Thread.run(Thread.java:780)
> [junit4:junit4]   1> Changed Locale to: root locale
> [junit4:junit4]   1> Changed Analyzer to: org.apache.lucene.collation.CollationKeyAnalyzer()
> [junit4:junit4]   1>
> [junit4:junit4]   1> --> Round 0-->1
> [junit4:junit4]   1>
> [junit4:junit4]   1> Changed Locale to: de
> [junit4:junit4]   1> Changed Analyzer to: org.apache.lucene.collation.CollationKeyAnalyzer(de)
> [junit4:junit4]   1>
> [junit4:junit4]   1> --> Round 0-->1
> [junit4:junit4]   1>
> [junit4:junit4]   1> Changed Locale to: en_US
> [junit4:junit4]   1> Changed Analyzer to: org.apache.lucene.collation.CollationKeyAnalyzer(en_US)
> [junit4:junit4]   1>
> [junit4:junit4]   1> --> Round 0-->1
> [junit4:junit4]   1>
> [junit4:junit4]   1> Changed Locale to: no_NO_NY
> [junit4:junit4]   1> Changed Analyzer to: org.apache.lucene.collation.CollationKeyAnalyzer(no_NO_NY)
> [junit4:junit4]   1>
> [junit4:junit4]   1> --> Round 0-->1
> [junit4:junit4]   1>
> [junit4:junit4]   1> ------------> starting task: Seq
> [junit4:junit4]   1> ------------> starting task: Rounds
> [junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestPerfTasksLogic -Dtests.method=testDisableCounting -Dtests.seed=900F08B0BE490539 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sq_AL -Dtests.timezone=Europe/Luxembourg -Dtests.file.encoding=ISO-8859-1
> [junit4:junit4] FAILURE 0.05s J0 | TestPerfTasksLogic.testDisableCounting <<<
> [junit4:junit4]    > Throwable #1: java.lang.AssertionError
> [junit4:junit4]    >    at __randomizedtesting.SeedInfo.seed([900F08B0BE490539:907019F611C3328B]:0)
> [junit4:junit4]    >    at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:73)
> [junit4:junit4]    >    at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
> [junit4:junit4]    >    at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
> [junit4:junit4]    >    at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
> [junit4:junit4]    >    at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finish(MemoryPostingsFormat.java:271)
> [junit4:junit4]    >    at org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTermsWriterPerField.java:553)
> [junit4:junit4]    >    at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:85)
> [junit4:junit4]    >    at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
> [junit4:junit4]    >    at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
> [junit4:junit4]    >    at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
> [junit4:junit4]    >    at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:488)
> [junit4:junit4]    >    at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:422)
> [junit4:junit4]    >    at org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:559)
> [junit4:junit4]    >    at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
> [junit4:junit4]    >    at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
> [junit4:junit4]    >    at org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:913)
> [junit4:junit4]    >    at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:868)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.CloseIndexTask.doLogic(CloseIndexTask.java:48)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.java:301)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:77)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(BenchmarkTestCase.java:83)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.doTestDisableCounting(TestPerfTasksLogic.java:860)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testDisableCounting(TestPerfTasksLogic.java:851)
> [junit4:junit4]    >    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> [junit4:junit4]    >    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
> [junit4:junit4]    >    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
> [junit4:junit4]    >    at java.lang.reflect.Method.invoke(Method.java:613)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
> [junit4:junit4]    >    at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
> [junit4:junit4]    >    at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> [junit4:junit4]    >    at java.lang.Thread.run(Thread.java:780)
> [junit4:junit4]   1> ------------> starting task: Seq
> [junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestPerfTasksLogic -Dtests.method=testReadTokens -Dtests.seed=900F08B0BE490539 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sq_AL -Dtests.timezone=Europe/Luxembourg -Dtests.file.encoding=ISO-8859-1
> [junit4:junit4] FAILURE 0.04s J0 | TestPerfTasksLogic.testReadTokens <<<
> [junit4:junit4]    > Throwable #1: java.lang.AssertionError
> [junit4:junit4]    >    at __randomizedtesting.SeedInfo.seed([900F08B0BE490539:47551770DF1E00E6]:0)
> [junit4:junit4]    >    at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:73)
> [junit4:junit4]    >    at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
> [junit4:junit4]    >    at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
> [junit4:junit4]    >    at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
> [junit4:junit4]    >    at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finish(MemoryPostingsFormat.java:271)
> [junit4:junit4]    >    at org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTermsWriterPerField.java:553)
> [junit4:junit4]    >    at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:85)
> [junit4:junit4]    >    at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
> [junit4:junit4]    >    at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
> [junit4:junit4]    >    at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
> [junit4:junit4]    >    at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:488)
> [junit4:junit4]    >    at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:422)
> [junit4:junit4]    >    at org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:559)
> [junit4:junit4]    >    at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
> [junit4:junit4]    >    at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
> [junit4:junit4]    >    at org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:913)
> [junit4:junit4]    >    at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:868)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.CloseIndexTask.doLogic(CloseIndexTask.java:48)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.java:301)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:77)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(BenchmarkTestCase.java:83)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testReadTokens(TestPerfTasksLogic.java:477)
> [junit4:junit4]    >    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> [junit4:junit4]    >    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
> [junit4:junit4]    >    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
> [junit4:junit4]    >    at java.lang.reflect.Method.invoke(Method.java:613)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
> [junit4:junit4]    >    at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
> [junit4:junit4]    >    at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> [junit4:junit4]    >    at java.lang.Thread.run(Thread.java:780)
> [junit4:junit4]   1> ------------> starting task: Seq
> [junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestPerfTasksLogic -Dtests.method=testLineDocFile -Dtests.seed=900F08B0BE490539 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sq_AL -Dtests.timezone=Europe/Luxembourg -Dtests.file.encoding=ISO-8859-1
> [junit4:junit4] FAILURE 0.10s J0 | TestPerfTasksLogic.testLineDocFile <<<
> [junit4:junit4]    > Throwable #1: java.lang.AssertionError
> [junit4:junit4]    >    at __randomizedtesting.SeedInfo.seed([900F08B0BE490539:6698ED24DD4E654A]:0)
> [junit4:junit4]    >    at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:73)
> [junit4:junit4]    >    at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
> [junit4:junit4]    >    at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
> [junit4:junit4]    >    at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
> [junit4:junit4]    >    at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finish(MemoryPostingsFormat.java:271)
> [junit4:junit4]    >    at org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTermsWriterPerField.java:553)
> [junit4:junit4]    >    at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:85)
> [junit4:junit4]    >    at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
> [junit4:junit4]    >    at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
> [junit4:junit4]    >    at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
> [junit4:junit4]    >    at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:488)
> [junit4:junit4]    >    at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:422)
> [junit4:junit4]    >    at org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:559)
> [junit4:junit4]    >    at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
> [junit4:junit4]    >    at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
> [junit4:junit4]    >    at org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:913)
> [junit4:junit4]    >    at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:868)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.CloseIndexTask.doLogic(CloseIndexTask.java:48)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.java:301)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:77)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(BenchmarkTestCase.java:83)
> [junit4:junit4]    >    at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testLineDocFile(TestPerfTasksLogic.java:438)
> [junit4:junit4]    >    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> [junit4:junit4]    >    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
> [junit4:junit4]    >    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
> [junit4:junit4]    >    at java.lang.reflect.Method.invoke(Method.java:613)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
> [junit4:junit4]    >    at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
> [junit4:junit4]    >    at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> [junit4:junit4]    >    at java.lang.Thread.run(Thread.java:780)
> [junit4:junit4]   2> NOTE: test params are: codec=Lucene41: {docdatenum=Lucene41(blocksize=128), doctitle=Lucene41(blocksize=128), $facets=Lucene41(blocksize=128), body=PostingsFormat(name=Memory doPackFST= true), docname=PostingsFormat(name=Memory doPackFST= false), docdate=PostingsFormat(name=Memory doPackFST= true), random_string=MockVariableIntBlock(baseBlockSize=96), docid=PostingsFormat(name=Memory doPackFST= false), $full_path$=MockVariableIntBlock(baseBlockSize=96), country=PostingsFormat(name=Memory doPackFST= true), sort_field=PostingsFormat(name=Memory doPackFST= false), doctimesecnum=PostingsFormat(name=Memory doPackFST= true), $payloads$=PostingsFormat(name=Memory doPackFST= false)}, sim=DefaultSimilarity, locale=sq_AL, timezone=Europe/Luxembourg
> [junit4:junit4]   2> NOTE: Linux 3.2.0-34-generic x86/IBM Corporation 1.7.0 (32-bit)/cpus=8,threads=1,free=11774776,total=20250624
> [junit4:junit4]   2> NOTE: All tests run in this JVM: [AltPackageTaskTest, WriteEnwikiLineDocTaskTest, TestPerfTasksLogic]
> [junit4:junit4] Completed on J0 in 7.68s, 23 tests, 14 failures <<< FAILURES!
>
> [...truncated 37 lines...]
> BUILD FAILED
> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:365: The following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build.xml:519: The following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1703: The following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/module-build.xml:61: The following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1175: The following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:839: There were test failures: 17 suites, 90 tests, 14 failures
>
> Total time: 60 minutes 12 seconds
> Build step 'Invoke Ant' marked build as failure
> Archiving artifacts
> Recording test results
> Description set: Java: 32bit/ibm-j9-jdk7
> Email was triggered for: Failure
> Sending email for trigger: Failure
>
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[JENKINS] Lucene-Solr-4.x-Linux (32bit/ibm-j9-jdk7) - Build # 3191 - Still Failing!

Posted by Policeman Jenkins Server <je...@sd-datasolutions.de>.
Build: http://jenkins.sd-datasolutions.de/job/Lucene-Solr-4.x-Linux/3191/
Java: 32bit/ibm-j9-jdk7 

14 tests failed.
REGRESSION:  org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testBGSearchTaskThreads

Error Message:


Stack Trace:
java.lang.AssertionError
	at __randomizedtesting.SeedInfo.seed([900F08B0BE490539:4D3ACD6C068AD49B]:0)
	at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:73)
	at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
	at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
	at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
	at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finish(MemoryPostingsFormat.java:271)
	at org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTermsWriterPerField.java:553)
	at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:85)
	at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
	at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
	at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
	at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:488)
	at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:422)
	at org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:559)
	at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
	at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
	at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1619)
	at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1595)
	at org.apache.lucene.benchmark.byTask.tasks.ForceMergeTask.doLogic(ForceMergeTask.java:41)
	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
	at org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.java:301)
	at org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:77)
	at org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(BenchmarkTestCase.java:83)
	at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testBGSearchTaskThreads(TestPerfTasksLogic.java:157)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
	at java.lang.reflect.Method.invoke(Method.java:613)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:780)


REGRESSION:  org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testExhaustContentSource

Error Message:


Stack Trace:
java.lang.AssertionError
	at __randomizedtesting.SeedInfo.seed([900F08B0BE490539:28FE72D1146C5FA0]:0)
	at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:73)
	at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
	at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
	at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
	at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finish(MemoryPostingsFormat.java:271)
	at org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTermsWriterPerField.java:553)
	at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:85)
	at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
	at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
	at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
	at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:488)
	at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:422)
	at org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:559)
	at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
	at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
	at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1619)
	at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1595)
	at org.apache.lucene.benchmark.byTask.tasks.ForceMergeTask.doLogic(ForceMergeTask.java:41)
	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
	at org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.java:301)
	at org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:77)
	at org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(BenchmarkTestCase.java:83)
	at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testExhaustContentSource(TestPerfTasksLogic.java:304)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
	at java.lang.reflect.Method.invoke(Method.java:613)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:780)


REGRESSION:  org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testExhaustedLooped

Error Message:


Stack Trace:
java.lang.AssertionError
	at __randomizedtesting.SeedInfo.seed([900F08B0BE490539:1AE3BB949772D23F]:0)
	at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:73)
	at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
	at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
	at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
	at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finish(MemoryPostingsFormat.java:271)
	at org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTermsWriterPerField.java:553)
	at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:85)
	at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
	at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
	at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
	at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:488)
	at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:422)
	at org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:559)
	at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
	at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
	at org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:913)
	at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:868)
	at org.apache.lucene.benchmark.byTask.tasks.CloseIndexTask.doLogic(CloseIndexTask.java:48)
	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
	at org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.java:301)
	at org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:77)
	at org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(BenchmarkTestCase.java:83)
	at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testExhaustedLooped(TestPerfTasksLogic.java:583)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
	at java.lang.reflect.Method.invoke(Method.java:613)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:780)


REGRESSION:  org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testIndexAndSearchTasks

Error Message:


Stack Trace:
java.lang.AssertionError
	at __randomizedtesting.SeedInfo.seed([900F08B0BE490539:E3C813A59FA3EB21]:0)
	at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:73)
	at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
	at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
	at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
	at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finish(MemoryPostingsFormat.java:271)
	at org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTermsWriterPerField.java:553)
	at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:85)
	at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
	at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
	at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
	at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:488)
	at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:422)
	at org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:559)
	at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
	at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
	at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1619)
	at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1595)
	at org.apache.lucene.benchmark.byTask.tasks.ForceMergeTask.doLogic(ForceMergeTask.java:41)
	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
	at org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.java:301)
	at org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:77)
	at org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(BenchmarkTestCase.java:83)
	at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testIndexAndSearchTasks(TestPerfTasksLogic.java:98)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
	at java.lang.reflect.Method.invoke(Method.java:613)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:780)


REGRESSION:  org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testCloseIndexFalse

Error Message:


Stack Trace:
java.lang.AssertionError
	at __randomizedtesting.SeedInfo.seed([900F08B0BE490539:66537D56A7655F69]:0)
	at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:73)
	at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
	at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
	at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
	at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finish(MemoryPostingsFormat.java:271)
	at org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTermsWriterPerField.java:553)
	at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:85)
	at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
	at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
	at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
	at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:488)
	at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:422)
	at org.apache.lucene.index.DocumentsWriter.postUpdate(DocumentsWriter.java:316)
	at org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:389)
	at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1458)
	at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1133)
	at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1114)
	at org.apache.lucene.benchmark.byTask.tasks.AddDocTask.doLogic(AddDocTask.java:70)
	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:132)
	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
	at org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.java:301)
	at org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:77)
	at org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(BenchmarkTestCase.java:83)
	at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testCloseIndexFalse(TestPerfTasksLogic.java:620)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
	at java.lang.reflect.Method.invoke(Method.java:613)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:780)


REGRESSION:  org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testHighlightingTV

Error Message:


Stack Trace:
java.lang.AssertionError
	at __randomizedtesting.SeedInfo.seed([900F08B0BE490539:F02D2EC62156EDA0]:0)
	at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:73)
	at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
	at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
	at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
	at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finish(MemoryPostingsFormat.java:271)
	at org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTermsWriterPerField.java:553)
	at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:85)
	at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
	at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
	at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
	at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:488)
	at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:422)
	at org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:559)
	at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
	at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
	at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1619)
	at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1595)
	at org.apache.lucene.benchmark.byTask.tasks.ForceMergeTask.doLogic(ForceMergeTask.java:41)
	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
	at org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.java:301)
	at org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:77)
	at org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(BenchmarkTestCase.java:83)
	at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testHighlightingTV(TestPerfTasksLogic.java:227)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
	at java.lang.reflect.Method.invoke(Method.java:613)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:780)


REGRESSION:  org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testParallelExhausted

Error Message:


Stack Trace:
java.lang.AssertionError
	at __randomizedtesting.SeedInfo.seed([900F08B0BE490539:D1A71DF46B968045]:0)
	at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:73)
	at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
	at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
	at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
	at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finish(MemoryPostingsFormat.java:271)
	at org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTermsWriterPerField.java:553)
	at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:85)
	at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
	at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
	at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
	at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:488)
	at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:422)
	at org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:559)
	at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
	at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
	at org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:913)
	at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:868)
	at org.apache.lucene.benchmark.byTask.tasks.CloseIndexTask.doLogic(CloseIndexTask.java:48)
	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
	at org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.java:301)
	at org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:77)
	at org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(BenchmarkTestCase.java:83)
	at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testParallelExhausted(TestPerfTasksLogic.java:546)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
	at java.lang.reflect.Method.invoke(Method.java:613)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:780)


REGRESSION:  org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testHighlightingNoTvNoStore

Error Message:


Stack Trace:
java.lang.AssertionError
	at __randomizedtesting.SeedInfo.seed([900F08B0BE490539:2B1EF047A6586966]:0)
	at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:73)
	at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
	at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
	at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
	at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finish(MemoryPostingsFormat.java:271)
	at org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTermsWriterPerField.java:553)
	at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:85)
	at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
	at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
	at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
	at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:488)
	at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:422)
	at org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:559)
	at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
	at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
	at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1619)
	at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1595)
	at org.apache.lucene.benchmark.byTask.tasks.ForceMergeTask.doLogic(ForceMergeTask.java:41)
	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
	at org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.java:301)
	at org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:77)
	at org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(BenchmarkTestCase.java:83)
	at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testHighlightingNoTvNoStore(TestPerfTasksLogic.java:266)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
	at java.lang.reflect.Method.invoke(Method.java:613)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:780)


REGRESSION:  org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testIndexWriterSettings

Error Message:


Stack Trace:
java.lang.AssertionError
	at __randomizedtesting.SeedInfo.seed([900F08B0BE490539:A8E67B1D32305055]:0)
	at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:73)
	at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
	at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
	at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
	at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finish(MemoryPostingsFormat.java:271)
	at org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTermsWriterPerField.java:553)
	at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:85)
	at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
	at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
	at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
	at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:488)
	at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:422)
	at org.apache.lucene.index.DocumentsWriter.postUpdate(DocumentsWriter.java:316)
	at org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:389)
	at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1458)
	at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1133)
	at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1114)
	at org.apache.lucene.benchmark.byTask.tasks.AddDocTask.doLogic(AddDocTask.java:70)
	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:132)
	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
	at org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.java:301)
	at org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:77)
	at org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(BenchmarkTestCase.java:83)
	at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testIndexWriterSettings(TestPerfTasksLogic.java:752)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
	at java.lang.reflect.Method.invoke(Method.java:613)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:780)


REGRESSION:  org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testIndexingWithFacets

Error Message:


Stack Trace:
java.lang.AssertionError
	at __randomizedtesting.SeedInfo.seed([900F08B0BE490539:B1ADCFFDAC233BD9]:0)
	at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:73)
	at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
	at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
	at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
	at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finish(MemoryPostingsFormat.java:271)
	at org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTermsWriterPerField.java:553)
	at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:85)
	at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
	at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
	at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
	at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:488)
	at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:422)
	at org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:559)
	at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
	at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
	at org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:913)
	at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:868)
	at org.apache.lucene.benchmark.byTask.tasks.CloseIndexTask.doLogic(CloseIndexTask.java:48)
	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
	at org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.java:301)
	at org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:77)
	at org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(BenchmarkTestCase.java:83)
	at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testIndexingWithFacets(TestPerfTasksLogic.java:794)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
	at java.lang.reflect.Method.invoke(Method.java:613)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:780)


REGRESSION:  org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testTimedSearchTask

Error Message:


Stack Trace:
java.lang.AssertionError
	at __randomizedtesting.SeedInfo.seed([900F08B0BE490539:652B526DF64A34D3]:0)
	at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:73)
	at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
	at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
	at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
	at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finish(MemoryPostingsFormat.java:271)
	at org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTermsWriterPerField.java:553)
	at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:85)
	at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
	at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
	at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
	at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:488)
	at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:422)
	at org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:559)
	at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
	at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
	at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1619)
	at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1595)
	at org.apache.lucene.benchmark.byTask.tasks.ForceMergeTask.doLogic(ForceMergeTask.java:41)
	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
	at org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.java:301)
	at org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:77)
	at org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(BenchmarkTestCase.java:83)
	at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testTimedSearchTask(TestPerfTasksLogic.java:130)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
	at java.lang.reflect.Method.invoke(Method.java:613)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:780)


REGRESSION:  org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testDisableCounting

Error Message:


Stack Trace:
java.lang.AssertionError
	at __randomizedtesting.SeedInfo.seed([900F08B0BE490539:907019F611C3328B]:0)
	at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:73)
	at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
	at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
	at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
	at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finish(MemoryPostingsFormat.java:271)
	at org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTermsWriterPerField.java:553)
	at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:85)
	at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
	at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
	at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
	at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:488)
	at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:422)
	at org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:559)
	at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
	at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
	at org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:913)
	at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:868)
	at org.apache.lucene.benchmark.byTask.tasks.CloseIndexTask.doLogic(CloseIndexTask.java:48)
	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
	at org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.java:301)
	at org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:77)
	at org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(BenchmarkTestCase.java:83)
	at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.doTestDisableCounting(TestPerfTasksLogic.java:860)
	at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testDisableCounting(TestPerfTasksLogic.java:851)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
	at java.lang.reflect.Method.invoke(Method.java:613)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:780)


REGRESSION:  org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testReadTokens

Error Message:


Stack Trace:
java.lang.AssertionError
	at __randomizedtesting.SeedInfo.seed([900F08B0BE490539:47551770DF1E00E6]:0)
	at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:73)
	at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
	at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
	at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
	at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finish(MemoryPostingsFormat.java:271)
	at org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTermsWriterPerField.java:553)
	at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:85)
	at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
	at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
	at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
	at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:488)
	at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:422)
	at org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:559)
	at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
	at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
	at org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:913)
	at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:868)
	at org.apache.lucene.benchmark.byTask.tasks.CloseIndexTask.doLogic(CloseIndexTask.java:48)
	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
	at org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.java:301)
	at org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:77)
	at org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(BenchmarkTestCase.java:83)
	at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testReadTokens(TestPerfTasksLogic.java:477)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
	at java.lang.reflect.Method.invoke(Method.java:613)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:780)


REGRESSION:  org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testLineDocFile

Error Message:


Stack Trace:
java.lang.AssertionError
	at __randomizedtesting.SeedInfo.seed([900F08B0BE490539:6698ED24DD4E654A]:0)
	at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:73)
	at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
	at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
	at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
	at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finish(MemoryPostingsFormat.java:271)
	at org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTermsWriterPerField.java:553)
	at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:85)
	at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
	at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
	at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
	at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:488)
	at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:422)
	at org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:559)
	at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
	at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
	at org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:913)
	at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:868)
	at org.apache.lucene.benchmark.byTask.tasks.CloseIndexTask.doLogic(CloseIndexTask.java:48)
	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
	at org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.java:301)
	at org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:77)
	at org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(BenchmarkTestCase.java:83)
	at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testLineDocFile(TestPerfTasksLogic.java:438)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
	at java.lang.reflect.Method.invoke(Method.java:613)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:780)




Build Log:
[...truncated 6122 lines...]
[junit4:junit4] Suite: org.apache.lucene.benchmark.byTask.TestPerfTasksLogic
[junit4:junit4]   1> ------------> starting task: Seq
[junit4:junit4]   1> ------------> starting task: Seq
[junit4:junit4]   1> ------------> starting task: Seq
[junit4:junit4]   1> ------------> starting task: Seq
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestPerfTasksLogic -Dtests.method=testBGSearchTaskThreads -Dtests.seed=900F08B0BE490539 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sq_AL -Dtests.timezone=Europe/Luxembourg -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] FAILURE 0.63s J0 | TestPerfTasksLogic.testBGSearchTaskThreads <<<
[junit4:junit4]    > Throwable #1: java.lang.AssertionError
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([900F08B0BE490539:4D3ACD6C068AD49B]:0)
[junit4:junit4]    > 	at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:73)
[junit4:junit4]    > 	at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
[junit4:junit4]    > 	at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
[junit4:junit4]    > 	at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
[junit4:junit4]    > 	at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finish(MemoryPostingsFormat.java:271)
[junit4:junit4]    > 	at org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTermsWriterPerField.java:553)
[junit4:junit4]    > 	at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:85)
[junit4:junit4]    > 	at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
[junit4:junit4]    > 	at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
[junit4:junit4]    > 	at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
[junit4:junit4]    > 	at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:488)
[junit4:junit4]    > 	at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:422)
[junit4:junit4]    > 	at org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:559)
[junit4:junit4]    > 	at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
[junit4:junit4]    > 	at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
[junit4:junit4]    > 	at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1619)
[junit4:junit4]    > 	at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1595)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.ForceMergeTask.doLogic(ForceMergeTask.java:41)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.java:301)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:77)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(BenchmarkTestCase.java:83)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testBGSearchTaskThreads(TestPerfTasksLogic.java:157)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
[junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:613)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:780)
[junit4:junit4]   1> ------------> starting task: Seq
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestPerfTasksLogic -Dtests.method=testExhaustContentSource -Dtests.seed=900F08B0BE490539 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sq_AL -Dtests.timezone=Europe/Luxembourg -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] FAILURE 0.05s J0 | TestPerfTasksLogic.testExhaustContentSource <<<
[junit4:junit4]    > Throwable #1: java.lang.AssertionError
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([900F08B0BE490539:28FE72D1146C5FA0]:0)
[junit4:junit4]    > 	at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:73)
[junit4:junit4]    > 	at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
[junit4:junit4]    > 	at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
[junit4:junit4]    > 	at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
[junit4:junit4]    > 	at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finish(MemoryPostingsFormat.java:271)
[junit4:junit4]    > 	at org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTermsWriterPerField.java:553)
[junit4:junit4]    > 	at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:85)
[junit4:junit4]    > 	at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
[junit4:junit4]    > 	at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
[junit4:junit4]    > 	at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
[junit4:junit4]    > 	at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:488)
[junit4:junit4]    > 	at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:422)
[junit4:junit4]    > 	at org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:559)
[junit4:junit4]    > 	at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
[junit4:junit4]    > 	at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
[junit4:junit4]    > 	at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1619)
[junit4:junit4]    > 	at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1595)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.ForceMergeTask.doLogic(ForceMergeTask.java:41)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.java:301)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:77)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(BenchmarkTestCase.java:83)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testExhaustContentSource(TestPerfTasksLogic.java:304)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
[junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:613)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:780)
[junit4:junit4]   1> Changed Locale to: null
[junit4:junit4]   1> 
[junit4:junit4]   1> --> Round 0-->1
[junit4:junit4]   1> 
[junit4:junit4]   1> Changed Locale to: root locale
[junit4:junit4]   1> 
[junit4:junit4]   1> --> Round 0-->1
[junit4:junit4]   1> 
[junit4:junit4]   1> Changed Locale to: de
[junit4:junit4]   1> 
[junit4:junit4]   1> --> Round 0-->1
[junit4:junit4]   1> 
[junit4:junit4]   1> Changed Locale to: en_US
[junit4:junit4]   1> 
[junit4:junit4]   1> --> Round 0-->1
[junit4:junit4]   1> 
[junit4:junit4]   1> Changed Locale to: no_NO_NY
[junit4:junit4]   1> 
[junit4:junit4]   1> --> Round 0-->1
[junit4:junit4]   1> 
[junit4:junit4]   1> ------------> starting task: Rounds_2
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestPerfTasksLogic -Dtests.method=testExhaustedLooped -Dtests.seed=900F08B0BE490539 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sq_AL -Dtests.timezone=Europe/Luxembourg -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] FAILURE 0.06s J0 | TestPerfTasksLogic.testExhaustedLooped <<<
[junit4:junit4]    > Throwable #1: java.lang.AssertionError
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([900F08B0BE490539:1AE3BB949772D23F]:0)
[junit4:junit4]    > 	at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:73)
[junit4:junit4]    > 	at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
[junit4:junit4]    > 	at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
[junit4:junit4]    > 	at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
[junit4:junit4]    > 	at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finish(MemoryPostingsFormat.java:271)
[junit4:junit4]    > 	at org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTermsWriterPerField.java:553)
[junit4:junit4]    > 	at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:85)
[junit4:junit4]    > 	at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
[junit4:junit4]    > 	at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
[junit4:junit4]    > 	at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
[junit4:junit4]    > 	at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:488)
[junit4:junit4]    > 	at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:422)
[junit4:junit4]    > 	at org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:559)
[junit4:junit4]    > 	at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
[junit4:junit4]    > 	at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
[junit4:junit4]    > 	at org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:913)
[junit4:junit4]    > 	at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:868)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.CloseIndexTask.doLogic(CloseIndexTask.java:48)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.java:301)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:77)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(BenchmarkTestCase.java:83)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testExhaustedLooped(TestPerfTasksLogic.java:583)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
[junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:613)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:780)
[junit4:junit4]   1> ------------> starting task: Seq
[junit4:junit4]   1> Changed Analyzer to: ShingleAnalyzerWrapper, wrapping ShingleFilter over org.apache.lucene.analysis.standard.StandardAnalyzer
[junit4:junit4]   1> ------------> starting task: Seq
[junit4:junit4]   1> Changed Analyzer to: ShingleAnalyzerWrapper, wrapping ShingleFilter over org.apache.lucene.analysis.standard.StandardAnalyzer
[junit4:junit4]   1> ------------> starting task: Seq
[junit4:junit4]   1> Changed Analyzer to: ShingleAnalyzerWrapper, wrapping ShingleFilter over org.apache.lucene.analysis.core.WhitespaceAnalyzer
[junit4:junit4]   1> ------------> starting task: Seq
[junit4:junit4]   1> Changed Analyzer to: ShingleAnalyzerWrapper, wrapping ShingleFilter over org.apache.lucene.analysis.core.WhitespaceAnalyzer
[junit4:junit4]   1> ------------> starting task: Seq
[junit4:junit4]   1>    0.16 sec --> TEST-TestPerfTasksLogic.testIndexAndSearchTasks-seed#[900F08B0BE490539] added      1000 docs
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestPerfTasksLogic -Dtests.method=testIndexAndSearchTasks -Dtests.seed=900F08B0BE490539 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sq_AL -Dtests.timezone=Europe/Luxembourg -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] FAILURE 0.25s J0 | TestPerfTasksLogic.testIndexAndSearchTasks <<<
[junit4:junit4]    > Throwable #1: java.lang.AssertionError
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([900F08B0BE490539:E3C813A59FA3EB21]:0)
[junit4:junit4]    > 	at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:73)
[junit4:junit4]    > 	at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
[junit4:junit4]    > 	at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
[junit4:junit4]    > 	at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
[junit4:junit4]    > 	at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finish(MemoryPostingsFormat.java:271)
[junit4:junit4]    > 	at org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTermsWriterPerField.java:553)
[junit4:junit4]    > 	at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:85)
[junit4:junit4]    > 	at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
[junit4:junit4]    > 	at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
[junit4:junit4]    > 	at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
[junit4:junit4]    > 	at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:488)
[junit4:junit4]    > 	at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:422)
[junit4:junit4]    > 	at org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:559)
[junit4:junit4]    > 	at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
[junit4:junit4]    > 	at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
[junit4:junit4]    > 	at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1619)
[junit4:junit4]    > 	at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1595)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.ForceMergeTask.doLogic(ForceMergeTask.java:41)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.java:301)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:77)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(BenchmarkTestCase.java:83)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testIndexAndSearchTasks(TestPerfTasksLogic.java:98)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
[junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:613)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:780)
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestPerfTasksLogic -Dtests.method=testCloseIndexFalse -Dtests.seed=900F08B0BE490539 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sq_AL -Dtests.timezone=Europe/Luxembourg -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] FAILURE 0.07s J0 | TestPerfTasksLogic.testCloseIndexFalse <<<
[junit4:junit4]    > Throwable #1: java.lang.AssertionError
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([900F08B0BE490539:66537D56A7655F69]:0)
[junit4:junit4]    > 	at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:73)
[junit4:junit4]    > 	at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
[junit4:junit4]    > 	at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
[junit4:junit4]    > 	at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
[junit4:junit4]    > 	at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finish(MemoryPostingsFormat.java:271)
[junit4:junit4]    > 	at org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTermsWriterPerField.java:553)
[junit4:junit4]    > 	at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:85)
[junit4:junit4]    > 	at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
[junit4:junit4]    > 	at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
[junit4:junit4]    > 	at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
[junit4:junit4]    > 	at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:488)
[junit4:junit4]    > 	at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:422)
[junit4:junit4]    > 	at org.apache.lucene.index.DocumentsWriter.postUpdate(DocumentsWriter.java:316)
[junit4:junit4]    > 	at org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:389)
[junit4:junit4]    > 	at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1458)
[junit4:junit4]    > 	at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1133)
[junit4:junit4]    > 	at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1114)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.AddDocTask.doLogic(AddDocTask.java:70)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:132)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.java:301)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:77)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(BenchmarkTestCase.java:83)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testCloseIndexFalse(TestPerfTasksLogic.java:620)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
[junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:613)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:780)
[junit4:junit4]   1> ------------> starting task: Seq
[junit4:junit4]   1>    0.69 sec --> TEST-TestPerfTasksLogic.testHighlightingTV-seed#[900F08B0BE490539] added      1000 docs
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestPerfTasksLogic -Dtests.method=testHighlightingTV -Dtests.seed=900F08B0BE490539 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sq_AL -Dtests.timezone=Europe/Luxembourg -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] FAILURE 0.89s J0 | TestPerfTasksLogic.testHighlightingTV <<<
[junit4:junit4]    > Throwable #1: java.lang.AssertionError
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([900F08B0BE490539:F02D2EC62156EDA0]:0)
[junit4:junit4]    > 	at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:73)
[junit4:junit4]    > 	at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
[junit4:junit4]    > 	at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
[junit4:junit4]    > 	at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
[junit4:junit4]    > 	at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finish(MemoryPostingsFormat.java:271)
[junit4:junit4]    > 	at org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTermsWriterPerField.java:553)
[junit4:junit4]    > 	at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:85)
[junit4:junit4]    > 	at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
[junit4:junit4]    > 	at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
[junit4:junit4]    > 	at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
[junit4:junit4]    > 	at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:488)
[junit4:junit4]    > 	at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:422)
[junit4:junit4]    > 	at org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:559)
[junit4:junit4]    > 	at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
[junit4:junit4]    > 	at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
[junit4:junit4]    > 	at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1619)
[junit4:junit4]    > 	at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1595)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.ForceMergeTask.doLogic(ForceMergeTask.java:41)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.java:301)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:77)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(BenchmarkTestCase.java:83)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testHighlightingTV(TestPerfTasksLogic.java:227)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
[junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:613)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:780)
[junit4:junit4]   1> ------------> starting task: Seq
[junit4:junit4]   1> ------------> starting task: CreateIndex
[junit4:junit4]   1> ------------> starting task: Seq_Exhaust
[junit4:junit4]   1> ------------> starting task: Seq_Exhaust
[junit4:junit4]   1> ------------> starting task: WaitForMerges
[junit4:junit4]   1> ------------> starting task: CloseIndex
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestPerfTasksLogic -Dtests.method=testParallelExhausted -Dtests.seed=900F08B0BE490539 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sq_AL -Dtests.timezone=Europe/Luxembourg -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] FAILURE 0.10s J0 | TestPerfTasksLogic.testParallelExhausted <<<
[junit4:junit4]    > Throwable #1: java.lang.AssertionError
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([900F08B0BE490539:D1A71DF46B968045]:0)
[junit4:junit4]    > 	at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:73)
[junit4:junit4]    > 	at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
[junit4:junit4]    > 	at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
[junit4:junit4]    > 	at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
[junit4:junit4]    > 	at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finish(MemoryPostingsFormat.java:271)
[junit4:junit4]    > 	at org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTermsWriterPerField.java:553)
[junit4:junit4]    > 	at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:85)
[junit4:junit4]    > 	at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
[junit4:junit4]    > 	at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
[junit4:junit4]    > 	at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
[junit4:junit4]    > 	at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:488)
[junit4:junit4]    > 	at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:422)
[junit4:junit4]    > 	at org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:559)
[junit4:junit4]    > 	at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
[junit4:junit4]    > 	at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
[junit4:junit4]    > 	at org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:913)
[junit4:junit4]    > 	at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:868)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.CloseIndexTask.doLogic(CloseIndexTask.java:48)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.java:301)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:77)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(BenchmarkTestCase.java:83)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testParallelExhausted(TestPerfTasksLogic.java:546)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
[junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:613)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:780)
[junit4:junit4]   1> ------------> starting task: Seq
[junit4:junit4]   1>    0.22 sec --> TEST-TestPerfTasksLogic.testHighlightingNoTvNoStore-seed#[900F08B0BE490539] added      1000 docs
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestPerfTasksLogic -Dtests.method=testHighlightingNoTvNoStore -Dtests.seed=900F08B0BE490539 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sq_AL -Dtests.timezone=Europe/Luxembourg -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] FAILURE 0.32s J0 | TestPerfTasksLogic.testHighlightingNoTvNoStore <<<
[junit4:junit4]    > Throwable #1: java.lang.AssertionError
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([900F08B0BE490539:2B1EF047A6586966]:0)
[junit4:junit4]    > 	at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:73)
[junit4:junit4]    > 	at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
[junit4:junit4]    > 	at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
[junit4:junit4]    > 	at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
[junit4:junit4]    > 	at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finish(MemoryPostingsFormat.java:271)
[junit4:junit4]    > 	at org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTermsWriterPerField.java:553)
[junit4:junit4]    > 	at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:85)
[junit4:junit4]    > 	at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
[junit4:junit4]    > 	at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
[junit4:junit4]    > 	at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
[junit4:junit4]    > 	at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:488)
[junit4:junit4]    > 	at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:422)
[junit4:junit4]    > 	at org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:559)
[junit4:junit4]    > 	at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
[junit4:junit4]    > 	at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
[junit4:junit4]    > 	at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1619)
[junit4:junit4]    > 	at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1595)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.ForceMergeTask.doLogic(ForceMergeTask.java:41)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.java:301)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:77)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(BenchmarkTestCase.java:83)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testHighlightingNoTvNoStore(TestPerfTasksLogic.java:266)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
[junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:613)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:780)
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestPerfTasksLogic -Dtests.method=testIndexWriterSettings -Dtests.seed=900F08B0BE490539 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sq_AL -Dtests.timezone=Europe/Luxembourg -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] FAILURE 0.04s J0 | TestPerfTasksLogic.testIndexWriterSettings <<<
[junit4:junit4]    > Throwable #1: java.lang.AssertionError
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([900F08B0BE490539:A8E67B1D32305055]:0)
[junit4:junit4]    > 	at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:73)
[junit4:junit4]    > 	at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
[junit4:junit4]    > 	at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
[junit4:junit4]    > 	at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
[junit4:junit4]    > 	at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finish(MemoryPostingsFormat.java:271)
[junit4:junit4]    > 	at org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTermsWriterPerField.java:553)
[junit4:junit4]    > 	at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:85)
[junit4:junit4]    > 	at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
[junit4:junit4]    > 	at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
[junit4:junit4]    > 	at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
[junit4:junit4]    > 	at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:488)
[junit4:junit4]    > 	at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:422)
[junit4:junit4]    > 	at org.apache.lucene.index.DocumentsWriter.postUpdate(DocumentsWriter.java:316)
[junit4:junit4]    > 	at org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:389)
[junit4:junit4]    > 	at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1458)
[junit4:junit4]    > 	at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1133)
[junit4:junit4]    > 	at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1114)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.AddDocTask.doLogic(AddDocTask.java:70)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:132)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.java:301)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:77)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(BenchmarkTestCase.java:83)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testIndexWriterSettings(TestPerfTasksLogic.java:752)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
[junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:613)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:780)
[junit4:junit4]   1> ------------> starting task: Seq
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestPerfTasksLogic -Dtests.method=testIndexingWithFacets -Dtests.seed=900F08B0BE490539 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sq_AL -Dtests.timezone=Europe/Luxembourg -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] FAILURE 0.71s J0 | TestPerfTasksLogic.testIndexingWithFacets <<<
[junit4:junit4]    > Throwable #1: java.lang.AssertionError
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([900F08B0BE490539:B1ADCFFDAC233BD9]:0)
[junit4:junit4]    > 	at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:73)
[junit4:junit4]    > 	at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
[junit4:junit4]    > 	at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
[junit4:junit4]    > 	at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
[junit4:junit4]    > 	at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finish(MemoryPostingsFormat.java:271)
[junit4:junit4]    > 	at org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTermsWriterPerField.java:553)
[junit4:junit4]    > 	at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:85)
[junit4:junit4]    > 	at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
[junit4:junit4]    > 	at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
[junit4:junit4]    > 	at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
[junit4:junit4]    > 	at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:488)
[junit4:junit4]    > 	at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:422)
[junit4:junit4]    > 	at org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:559)
[junit4:junit4]    > 	at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
[junit4:junit4]    > 	at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
[junit4:junit4]    > 	at org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:913)
[junit4:junit4]    > 	at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:868)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.CloseIndexTask.doLogic(CloseIndexTask.java:48)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.java:301)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:77)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(BenchmarkTestCase.java:83)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testIndexingWithFacets(TestPerfTasksLogic.java:794)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
[junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:613)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:780)
[junit4:junit4]   1> ------------> starting task: Seq
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestPerfTasksLogic -Dtests.method=testTimedSearchTask -Dtests.seed=900F08B0BE490539 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sq_AL -Dtests.timezone=Europe/Luxembourg -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] FAILURE 0.07s J0 | TestPerfTasksLogic.testTimedSearchTask <<<
[junit4:junit4]    > Throwable #1: java.lang.AssertionError
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([900F08B0BE490539:652B526DF64A34D3]:0)
[junit4:junit4]    > 	at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:73)
[junit4:junit4]    > 	at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
[junit4:junit4]    > 	at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
[junit4:junit4]    > 	at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
[junit4:junit4]    > 	at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finish(MemoryPostingsFormat.java:271)
[junit4:junit4]    > 	at org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTermsWriterPerField.java:553)
[junit4:junit4]    > 	at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:85)
[junit4:junit4]    > 	at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
[junit4:junit4]    > 	at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
[junit4:junit4]    > 	at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
[junit4:junit4]    > 	at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:488)
[junit4:junit4]    > 	at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:422)
[junit4:junit4]    > 	at org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:559)
[junit4:junit4]    > 	at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
[junit4:junit4]    > 	at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
[junit4:junit4]    > 	at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1619)
[junit4:junit4]    > 	at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1595)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.ForceMergeTask.doLogic(ForceMergeTask.java:41)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.java:301)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:77)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(BenchmarkTestCase.java:83)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testTimedSearchTask(TestPerfTasksLogic.java:130)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
[junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:613)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:780)
[junit4:junit4]   1> Changed Locale to: root locale
[junit4:junit4]   1> Changed Analyzer to: org.apache.lucene.collation.CollationKeyAnalyzer()
[junit4:junit4]   1> 
[junit4:junit4]   1> --> Round 0-->1
[junit4:junit4]   1> 
[junit4:junit4]   1> Changed Locale to: de
[junit4:junit4]   1> Changed Analyzer to: org.apache.lucene.collation.CollationKeyAnalyzer(de)
[junit4:junit4]   1> 
[junit4:junit4]   1> --> Round 0-->1
[junit4:junit4]   1> 
[junit4:junit4]   1> Changed Locale to: en_US
[junit4:junit4]   1> Changed Analyzer to: org.apache.lucene.collation.CollationKeyAnalyzer(en_US)
[junit4:junit4]   1> 
[junit4:junit4]   1> --> Round 0-->1
[junit4:junit4]   1> 
[junit4:junit4]   1> Changed Locale to: no_NO_NY
[junit4:junit4]   1> Changed Analyzer to: org.apache.lucene.collation.CollationKeyAnalyzer(no_NO_NY)
[junit4:junit4]   1> 
[junit4:junit4]   1> --> Round 0-->1
[junit4:junit4]   1> 
[junit4:junit4]   1> ------------> starting task: Seq
[junit4:junit4]   1> ------------> starting task: Rounds
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestPerfTasksLogic -Dtests.method=testDisableCounting -Dtests.seed=900F08B0BE490539 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sq_AL -Dtests.timezone=Europe/Luxembourg -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] FAILURE 0.05s J0 | TestPerfTasksLogic.testDisableCounting <<<
[junit4:junit4]    > Throwable #1: java.lang.AssertionError
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([900F08B0BE490539:907019F611C3328B]:0)
[junit4:junit4]    > 	at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:73)
[junit4:junit4]    > 	at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
[junit4:junit4]    > 	at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
[junit4:junit4]    > 	at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
[junit4:junit4]    > 	at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finish(MemoryPostingsFormat.java:271)
[junit4:junit4]    > 	at org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTermsWriterPerField.java:553)
[junit4:junit4]    > 	at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:85)
[junit4:junit4]    > 	at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
[junit4:junit4]    > 	at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
[junit4:junit4]    > 	at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
[junit4:junit4]    > 	at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:488)
[junit4:junit4]    > 	at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:422)
[junit4:junit4]    > 	at org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:559)
[junit4:junit4]    > 	at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
[junit4:junit4]    > 	at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
[junit4:junit4]    > 	at org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:913)
[junit4:junit4]    > 	at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:868)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.CloseIndexTask.doLogic(CloseIndexTask.java:48)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.java:301)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:77)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(BenchmarkTestCase.java:83)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.doTestDisableCounting(TestPerfTasksLogic.java:860)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testDisableCounting(TestPerfTasksLogic.java:851)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
[junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:613)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:780)
[junit4:junit4]   1> ------------> starting task: Seq
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestPerfTasksLogic -Dtests.method=testReadTokens -Dtests.seed=900F08B0BE490539 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sq_AL -Dtests.timezone=Europe/Luxembourg -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] FAILURE 0.04s J0 | TestPerfTasksLogic.testReadTokens <<<
[junit4:junit4]    > Throwable #1: java.lang.AssertionError
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([900F08B0BE490539:47551770DF1E00E6]:0)
[junit4:junit4]    > 	at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:73)
[junit4:junit4]    > 	at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
[junit4:junit4]    > 	at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
[junit4:junit4]    > 	at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
[junit4:junit4]    > 	at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finish(MemoryPostingsFormat.java:271)
[junit4:junit4]    > 	at org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTermsWriterPerField.java:553)
[junit4:junit4]    > 	at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:85)
[junit4:junit4]    > 	at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
[junit4:junit4]    > 	at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
[junit4:junit4]    > 	at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
[junit4:junit4]    > 	at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:488)
[junit4:junit4]    > 	at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:422)
[junit4:junit4]    > 	at org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:559)
[junit4:junit4]    > 	at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
[junit4:junit4]    > 	at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
[junit4:junit4]    > 	at org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:913)
[junit4:junit4]    > 	at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:868)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.CloseIndexTask.doLogic(CloseIndexTask.java:48)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.java:301)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:77)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(BenchmarkTestCase.java:83)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testReadTokens(TestPerfTasksLogic.java:477)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
[junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:613)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:780)
[junit4:junit4]   1> ------------> starting task: Seq
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestPerfTasksLogic -Dtests.method=testLineDocFile -Dtests.seed=900F08B0BE490539 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sq_AL -Dtests.timezone=Europe/Luxembourg -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] FAILURE 0.10s J0 | TestPerfTasksLogic.testLineDocFile <<<
[junit4:junit4]    > Throwable #1: java.lang.AssertionError
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([900F08B0BE490539:6698ED24DD4E654A]:0)
[junit4:junit4]    > 	at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:73)
[junit4:junit4]    > 	at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:87)
[junit4:junit4]    > 	at org.apache.lucene.util.fst.FST.pack(FST.java:1531)
[junit4:junit4]    > 	at org.apache.lucene.util.fst.Builder.finish(Builder.java:481)
[junit4:junit4]    > 	at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finish(MemoryPostingsFormat.java:271)
[junit4:junit4]    > 	at org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTermsWriterPerField.java:553)
[junit4:junit4]    > 	at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:85)
[junit4:junit4]    > 	at org.apache.lucene.index.TermsHash.flush(TermsHash.java:116)
[junit4:junit4]    > 	at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
[junit4:junit4]    > 	at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:81)
[junit4:junit4]    > 	at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:488)
[junit4:junit4]    > 	at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:422)
[junit4:junit4]    > 	at org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:559)
[junit4:junit4]    > 	at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2899)
[junit4:junit4]    > 	at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2875)
[junit4:junit4]    > 	at org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:913)
[junit4:junit4]    > 	at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:868)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.CloseIndexTask.doLogic(CloseIndexTask.java:48)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doSerialTasks(TaskSequence.java:197)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.TaskSequence.doLogic(TaskSequence.java:138)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.tasks.PerfTask.runAndMaybeStats(PerfTask.java:143)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.utils.Algorithm.execute(Algorithm.java:301)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.Benchmark.execute(Benchmark.java:77)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.BenchmarkTestCase.execBenchmark(BenchmarkTestCase.java:83)
[junit4:junit4]    > 	at org.apache.lucene.benchmark.byTask.TestPerfTasksLogic.testLineDocFile(TestPerfTasksLogic.java:438)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
[junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:613)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:780)
[junit4:junit4]   2> NOTE: test params are: codec=Lucene41: {docdatenum=Lucene41(blocksize=128), doctitle=Lucene41(blocksize=128), $facets=Lucene41(blocksize=128), body=PostingsFormat(name=Memory doPackFST= true), docname=PostingsFormat(name=Memory doPackFST= false), docdate=PostingsFormat(name=Memory doPackFST= true), random_string=MockVariableIntBlock(baseBlockSize=96), docid=PostingsFormat(name=Memory doPackFST= false), $full_path$=MockVariableIntBlock(baseBlockSize=96), country=PostingsFormat(name=Memory doPackFST= true), sort_field=PostingsFormat(name=Memory doPackFST= false), doctimesecnum=PostingsFormat(name=Memory doPackFST= true), $payloads$=PostingsFormat(name=Memory doPackFST= false)}, sim=DefaultSimilarity, locale=sq_AL, timezone=Europe/Luxembourg
[junit4:junit4]   2> NOTE: Linux 3.2.0-34-generic x86/IBM Corporation 1.7.0 (32-bit)/cpus=8,threads=1,free=11774776,total=20250624
[junit4:junit4]   2> NOTE: All tests run in this JVM: [AltPackageTaskTest, WriteEnwikiLineDocTaskTest, TestPerfTasksLogic]
[junit4:junit4] Completed on J0 in 7.68s, 23 tests, 14 failures <<< FAILURES!

[...truncated 37 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:365: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build.xml:519: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1703: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/module-build.xml:61: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1175: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:839: There were test failures: 17 suites, 90 tests, 14 failures

Total time: 60 minutes 12 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 32bit/ibm-j9-jdk7 
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-4.x-Linux (64bit/jdk1.8.0-ea-b65) - Build # 3190 - Still Failing!

Posted by Policeman Jenkins Server <je...@sd-datasolutions.de>.
Build: http://jenkins.sd-datasolutions.de/job/Lucene-Solr-4.x-Linux/3190/
Java: 64bit/jdk1.8.0-ea-b65 -XX:+UseConcMarkSweepGC

2 tests failed.
FAILED:  org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch

Error Message:
There are still nodes recoverying - waited for 540 seconds

Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 540 seconds
	at __randomizedtesting.SeedInfo.seed([5D02DE20BB4242EB:DCE45038CC1D22D7]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:165)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:115)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:110)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:563)
	at org.apache.solr.cloud.BasicDistributedZk2Test.brindDownShardIndexSomeDocsAndRecover(BasicDistributedZk2Test.java:321)
	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:83)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:474)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)


FAILED:  org.apache.solr.cloud.BasicDistributedZkTest.testDistribSearch

Error Message:
Server at http://127.0.0.1:43697/solr returned non ok status:500, message:Server Error

Stack Trace:
org.apache.solr.common.SolrException: Server at http://127.0.0.1:43697/solr returned non ok status:500, message:Server Error
	at __randomizedtesting.SeedInfo.seed([5D02DE20BB4242EB:DCE45038CC1D22D7]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:374)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
	at org.apache.solr.client.solrj.request.CoreAdminRequest.process(CoreAdminRequest.java:429)
	at org.apache.solr.client.solrj.request.CoreAdminRequest.getStatus(CoreAdminRequest.java:472)
	at org.apache.solr.cloud.BasicDistributedZkTest.collectStartTimes(BasicDistributedZkTest.java:959)
	at org.apache.solr.cloud.BasicDistributedZkTest.testCollectionsAPI(BasicDistributedZkTest.java:795)
	at org.apache.solr.cloud.BasicDistributedZkTest.doTest(BasicDistributedZkTest.java:343)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:474)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)




Build Log:
[...truncated 8545 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZkTest
[junit4:junit4]   2> 10 T25 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZkTest-1355347372398
[junit4:junit4]   2> 17 T25 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 20 T26 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 41 T26 oaz.Environment.logEnv Server environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
[junit4:junit4]   2> 41 T26 oaz.Environment.logEnv Server environment:host.name=serv1
[junit4:junit4]   2> 41 T26 oaz.Environment.logEnv Server environment:java.version=1.8.0-ea
[junit4:junit4]   2> 42 T26 oaz.Environment.logEnv Server environment:java.vendor=Oracle Corporation
[junit4:junit4]   2> 42 T26 oaz.Environment.logEnv Server environment:java.home=/mnt/ssd/jenkins/tools/java/64bit/jdk1.8.0-ea-b65/jre
[junit4:junit4]   2> 42 T26 oaz.Environment.logEnv Server environment:java.class.path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/test:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/codecs/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-solrj/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/common/lucene-analyzers-common-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/highlighter/lucene-highlighter-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/memory/lucene-memory-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/misc/lucene-misc-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/spatial/lucene-spatial-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/suggest/lucene-suggest-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/grouping/lucene-grouping-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queries/lucene-queries-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queryparser/lucene-queryparser-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/cglib-nodep-2.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-cli-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-codec-1.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-fileupload-1.2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-lang-2.6.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/easymock-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/guava-13.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/javax.servlet-api-3.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/metrics-core-2.1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/objenesis-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/spatial4j-0.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/commons-io-2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpclient-4.1.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpcore-4.1.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpmime-4.1.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/jcl-over-slf4j-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/log4j-over-slf4j-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-api-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-jdk14-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/wstx-asl-3.2.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/zookeeper-3.4.5.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-continuation-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-deploy-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-http-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-io-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-jmx-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-security-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-server-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-servlet-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-util-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-webapp-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-xml-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/servlet-api-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/hsqldb-1.8.0.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/junit-4.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/randomizedtesting-runner-2.0.5.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-launcher.jar:/var/lib/jenkins/.ant/lib/ivy-2.2.0.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jdepend.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-netrexx.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-antlr.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-commons-net.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-javamail.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-regexp.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jsch.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-xalan2.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-junit4.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jmf.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-junit.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-bcel.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jai.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-commons-logging.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-resolver.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-oro.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-swing.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-bsf.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-log4j.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-testutil.jar:/mnt/ssd/jenkins/tools/java/64bit/jdk1.8.0-ea-b65/lib/tools.jar:/var/lib/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.0.5.jar
[junit4:junit4]   2> 43 T26 oaz.Environment.logEnv Server environment:java.library.path=/mnt/ssd/jenkins/tools/java/64bit/jdk1.8.0-ea-b65/jre/lib/amd64/server:/mnt/ssd/jenkins/tools/java/64bit/jdk1.8.0-ea-b65/jre/lib/amd64:/mnt/ssd/jenkins/tools/java/64bit/jdk1.8.0-ea-b65/jre/../lib/amd64:/usr/lib/jvm/j2sdk1.6-sun/jre/lib/amd64/server:/usr/lib/jvm/j2sdk1.6-sun/jre/lib/amd64:/usr/lib/jvm/j2sdk1.6-sun/jre/../lib/amd64:/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
[junit4:junit4]   2> 43 T26 oaz.Environment.logEnv Server environment:java.io.tmpdir=.
[junit4:junit4]   2> 43 T26 oaz.Environment.logEnv Server environment:java.compiler=<NA>
[junit4:junit4]   2> 43 T26 oaz.Environment.logEnv Server environment:os.name=Linux
[junit4:junit4]   2> 44 T26 oaz.Environment.logEnv Server environment:os.arch=amd64
[junit4:junit4]   2> 44 T26 oaz.Environment.logEnv Server environment:os.version=3.2.0-34-generic
[junit4:junit4]   2> 44 T26 oaz.Environment.logEnv Server environment:user.name=jenkins
[junit4:junit4]   2> 44 T26 oaz.Environment.logEnv Server environment:user.home=/var/lib/jenkins
[junit4:junit4]   2> 44 T26 oaz.Environment.logEnv Server environment:user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 64 T26 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 64 T26 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4]   2> 64 T26 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4]   2> 73 T26 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 108 T26 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355347372396/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4]   2> 120 T25 oasc.ZkTestServer.run start zk server on port:57274
[junit4:junit4]   2> 146 T25 oaz.Environment.logEnv Client environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
[junit4:junit4]   2> 146 T25 oaz.Environment.logEnv Client environment:host.name=serv1
[junit4:junit4]   2> 147 T25 oaz.Environment.logEnv Client environment:java.version=1.8.0-ea
[junit4:junit4]   2> 152 T25 oaz.Environment.logEnv Client environment:java.vendor=Oracle Corporation
[junit4:junit4]   2> 153 T25 oaz.Environment.logEnv Client environment:java.home=/mnt/ssd/jenkins/tools/java/64bit/jdk1.8.0-ea-b65/jre
[junit4:junit4]   2> 153 T25 oaz.Environment.logEnv Client environment:java.class.path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/test:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/codecs/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-solrj/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/common/lucene-analyzers-common-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/highlighter/lucene-highlighter-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/memory/lucene-memory-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/misc/lucene-misc-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/spatial/lucene-spatial-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/suggest/lucene-suggest-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/grouping/lucene-grouping-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queries/lucene-queries-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queryparser/lucene-queryparser-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/cglib-nodep-2.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-cli-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-codec-1.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-fileupload-1.2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-lang-2.6.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/easymock-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/guava-13.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/javax.servlet-api-3.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/metrics-core-2.1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/objenesis-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/spatial4j-0.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/commons-io-2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpclient-4.1.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpcore-4.1.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpmime-4.1.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/jcl-over-slf4j-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/log4j-over-slf4j-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-api-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-jdk14-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/wstx-asl-3.2.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/zookeeper-3.4.5.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-continuation-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-deploy-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-http-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-io-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-jmx-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-security-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-server-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-servlet-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-util-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-webapp-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-xml-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/servlet-api-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/hsqldb-1.8.0.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/junit-4.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/randomizedtesting-runner-2.0.5.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-launcher.jar:/var/lib/jenkins/.ant/lib/ivy-2.2.0.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jdepend.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-netrexx.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-antlr.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-commons-net.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-javamail.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-regexp.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jsch.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-xalan2.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-junit4.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jmf.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-junit.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-bcel.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jai.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-commons-logging.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-resolver.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-oro.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-swing.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-bsf.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-log4j.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-testutil.jar:/mnt/ssd/jenkins/tools/java/64bit/jdk1.8.0-ea-b65/lib/tools.jar:/var/lib/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.0.5.jar
[junit4:junit4]   2> 157 T25 oaz.Environment.logEnv Client environment:java.library.path=/mnt/ssd/jenkins/tools/java/64bit/jdk1.8.0-ea-b65/jre/lib/amd64/server:/mnt/ssd/jenkins/tools/java/64bit/jdk1.8.0-ea-b65/jre/lib/amd64:/mnt/ssd/jenkins/tools/java/64bit/jdk1.8.0-ea-b65/jre/../lib/amd64:/usr/lib/jvm/j2sdk1.6-sun/jre/lib/amd64/server:/usr/lib/jvm/j2sdk1.6-sun/jre/lib/amd64:/usr/lib/jvm/j2sdk1.6-sun/jre/../lib/amd64:/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
[junit4:junit4]   2> 158 T25 oaz.Environment.logEnv Client environment:java.io.tmpdir=.
[junit4:junit4]   2> 158 T25 oaz.Environment.logEnv Client environment:java.compiler=<NA>
[junit4:junit4]   2> 159 T25 oaz.Environment.logEnv Client environment:os.name=Linux
[junit4:junit4]   2> 159 T25 oaz.Environment.logEnv Client environment:os.arch=amd64
[junit4:junit4]   2> 160 T25 oaz.Environment.logEnv Client environment:os.version=3.2.0-34-generic
[junit4:junit4]   2> 164 T25 oaz.Environment.logEnv Client environment:user.name=jenkins
[junit4:junit4]   2> 164 T25 oaz.Environment.logEnv Client environment:user.home=/var/lib/jenkins
[junit4:junit4]   2> 165 T25 oaz.Environment.logEnv Client environment:user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 167 T25 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57274 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@22a37c0
[junit4:junit4]   2> 214 T25 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 217 T31 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:57274. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 220 T31 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:57274, initiating session
[junit4:junit4]   2> 356 T27 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:44005
[junit4:junit4]   2> 366 T27 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:44005
[junit4:junit4]   2> 370 T29 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 382 T29 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b90ffa9e80000 with negotiated timeout 10000 for client /127.0.0.1:44005
[junit4:junit4]   2> 383 T31 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:57274, sessionid = 0x13b90ffa9e80000, negotiated timeout = 10000
[junit4:junit4]   2> 387 T32 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@22a37c0 name:ZooKeeperConnection Watcher:127.0.0.1:57274 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 387 T25 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 389 T25 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 415 T30 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b90ffa9e80000
[junit4:junit4]   2> 417 T25 oaz.ZooKeeper.close Session: 0x13b90ffa9e80000 closed
[junit4:junit4]   2> 417 T32 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 418 T25 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57274/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@34014397
[junit4:junit4]   2> 418 T27 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:44005 which had sessionid 0x13b90ffa9e80000
[junit4:junit4]   2> 419 T25 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 420 T33 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:57274. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 420 T33 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:57274, initiating session
[junit4:junit4]   2> 420 T27 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:44006
[junit4:junit4]   2> 421 T27 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:44006
[junit4:junit4]   2> 422 T29 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b90ffa9e80001 with negotiated timeout 10000 for client /127.0.0.1:44006
[junit4:junit4]   2> 422 T33 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:57274, sessionid = 0x13b90ffa9e80001, negotiated timeout = 10000
[junit4:junit4]   2> 423 T34 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@34014397 name:ZooKeeperConnection Watcher:127.0.0.1:57274/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 423 T25 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 428 T25 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 434 T25 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 438 T25 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 441 T25 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 446 T25 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 455 T25 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 462 T25 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 464 T25 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 469 T25 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 471 T25 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 478 T25 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 478 T25 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 482 T25 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 483 T25 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 486 T25 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 486 T25 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 495 T25 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 496 T25 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 500 T25 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 501 T25 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 507 T25 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 508 T25 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 512 T25 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 513 T25 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 524 T30 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b90ffa9e80001
[junit4:junit4]   2> 525 T34 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 525 T25 oaz.ZooKeeper.close Session: 0x13b90ffa9e80001 closed
[junit4:junit4]   2> 525 T27 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:44006 which had sessionid 0x13b90ffa9e80001
[junit4:junit4]   2> 684 T25 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 771 T25 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:43697
[junit4:junit4]   2> 782 T25 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 782 T25 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355347372911
[junit4:junit4]   2> 783 T25 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355347372911/'
[junit4:junit4]   2> 798 T25 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 799 T25 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 799 T25 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355347372911
[junit4:junit4]   2> 800 T25 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355347372911/solr.xml
[junit4:junit4]   2> 800 T25 oasc.CoreContainer.<init> New CoreContainer 37142253
[junit4:junit4]   2> 801 T25 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355347372911/'
[junit4:junit4]   2> 801 T25 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355347372911/'
[junit4:junit4]   2> 826 T25 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 838 T25 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:57274/solr
[junit4:junit4]   2> 847 T25 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 848 T25 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57274 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@749c2306
[junit4:junit4]   2> 854 T25 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 855 T45 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:57274. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 856 T45 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:57274, initiating session
[junit4:junit4]   2> 856 T27 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:44008
[junit4:junit4]   2> 856 T27 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:44008
[junit4:junit4]   2> 858 T29 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b90ffa9e80002 with negotiated timeout 20000 for client /127.0.0.1:44008
[junit4:junit4]   2> 858 T45 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:57274, sessionid = 0x13b90ffa9e80002, negotiated timeout = 20000
[junit4:junit4]   2> 859 T46 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@749c2306 name:ZooKeeperConnection Watcher:127.0.0.1:57274 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 859 T25 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 861 T30 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b90ffa9e80002
[junit4:junit4]   2> 862 T27 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:44008 which had sessionid 0x13b90ffa9e80002
[junit4:junit4]   2> 863 T46 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 863 T25 oaz.ZooKeeper.close Session: 0x13b90ffa9e80002 closed
[junit4:junit4]   2> 867 T25 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57274/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@df7e227
[junit4:junit4]   2> 869 T25 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 870 T47 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:57274. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 871 T47 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:57274, initiating session
[junit4:junit4]   2> 871 T27 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:44009
[junit4:junit4]   2> 871 T27 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:44009
[junit4:junit4]   2> 872 T29 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b90ffa9e80003 with negotiated timeout 8000 for client /127.0.0.1:44009
[junit4:junit4]   2> 872 T47 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:57274, sessionid = 0x13b90ffa9e80003, negotiated timeout = 8000
[junit4:junit4]   2> 873 T48 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@df7e227 name:ZooKeeperConnection Watcher:127.0.0.1:57274/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 873 T25 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 881 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b90ffa9e80003 type:create cxid:0x2 zxid:0x1b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 885 T25 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 888 T25 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43697_solr
[junit4:junit4]   2> 890 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b90ffa9e80003 type:delete cxid:0x7 zxid:0x1d txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:43697_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:43697_solr
[junit4:junit4]   2> 892 T25 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:43697_solr
[junit4:junit4]   2> 895 T25 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 895 T25 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 896 T25 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 896 T25 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 896 T25 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 897 T25 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 897 T25 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 897 T25 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 898 T25 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 898 T25 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 903 T25 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 939 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b90ffa9e80003 type:delete cxid:0x15 zxid:0x22 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 940 T25 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 946 T25 oasc.Overseer.start Overseer (id=88824045405470723-127.0.0.1:43697_solr-n_0000000000) starting
[junit4:junit4]   2> 947 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b90ffa9e80003 type:create cxid:0x1a zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 954 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b90ffa9e80003 type:create cxid:0x1b zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 957 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b90ffa9e80003 type:create cxid:0x1c zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 972 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b90ffa9e80003 type:create cxid:0x1d zxid:0x27 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 976 T50 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
[junit4:junit4]   2> 977 T25 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 980 T25 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 1004 T49 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 1027 T51 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355347372911/collection1
[junit4:junit4]   2> 1027 T51 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4]   2> 1030 T51 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 1031 T51 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4]   2> 1039 T51 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355347372911/collection1/'
[junit4:junit4]   2> 1040 T51 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355347372911/collection1/lib/README' to classloader
[junit4:junit4]   2> 1040 T51 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355347372911/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 1137 T51 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 1201 T51 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 1203 T51 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 1222 T51 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 1750 T51 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 1766 T51 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 1772 T51 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 1807 T51 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1813 T51 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1820 T51 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1822 T51 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1825 T51 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355347372911/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355347372396/control/data/
[junit4:junit4]   2> 1827 T51 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@48783691
[junit4:junit4]   2> 1839 T51 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355347372396/control/data/index/
[junit4:junit4]   2> 1840 T51 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355347372396/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 1841 T51 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355347372396/control/data/index forceNew:false
[junit4:junit4]   2> 1846 T51 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355347372396/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@23377225; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 1846 T51 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 1847 T51 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 1849 T51 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 1850 T51 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 1850 T51 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 1856 T51 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 1857 T51 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 1857 T51 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 1858 T51 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 1877 T51 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 1879 T51 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 1886 T51 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 1891 T51 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 1892 T51 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 1893 T51 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 1893 T51 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 1898 T51 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 1899 T51 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 1900 T51 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1901 T51 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1903 T51 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1904 T51 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1905 T51 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1906 T51 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1907 T51 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1908 T51 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 1909 T51 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 1912 T51 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 1914 T51 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 1917 T51 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [CURRENCY.XML, OLD_SYNONYMS.TXT, PROTWORDS.TXT, SYNONYMS.TXT, SCHEMA.XML, OPEN-EXCHANGE-RATES.JSON, STOPWORDS.TXT, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 1922 T51 oass.SolrIndexSearcher.<init> Opening Searcher@8f65bc0 main
[junit4:junit4]   2> 1922 T51 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 1930 T51 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 1931 T51 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 1931 T51 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 1935 T51 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 1962 T52 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@8f65bc0 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 1968 T51 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 1968 T51 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 1970 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b90ffa9e80003 type:create cxid:0x53 zxid:0x2a txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 1981 T51 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 1982 T51 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:43697/solr shardId:control_shard
[junit4:junit4]   2> 1990 T51 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4]   2> 2007 T51 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/control_shard/election
[junit4:junit4]   2> 2014 T49 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2016 T49 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:43697_solr",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "shard":"control_shard",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:43697/solr",
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "operation":"state"}
[junit4:junit4]   2> 2022 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b90ffa9e80003 type:create cxid:0x66 zxid:0x31 txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 2030 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b90ffa9e80003 type:delete cxid:0x6d zxid:0x35 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4]   2> 2031 T51 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 2034 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b90ffa9e80003 type:create cxid:0x70 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2035 T48 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 2539 T51 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 2540 T51 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 2540 T51 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:43697/solr/collection1/
[junit4:junit4]   2> 2541 T51 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 2541 T51 oasc.SyncStrategy.syncToMe http://127.0.0.1:43697/solr/collection1/ has no replicas
[junit4:junit4]   2> 2541 T51 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:43697/solr/collection1/
[junit4:junit4]   2> 2541 T51 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/control_shard
[junit4:junit4]   2> 2549 T49 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2556 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b90ffa9e80003 type:create cxid:0x89 zxid:0x3e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2560 T48 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 3067 T49 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3072 T48 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 3112 T51 oasc.ZkController.register We are http://127.0.0.1:43697/solr/collection1/ and leader is http://127.0.0.1:43697/solr/collection1/
[junit4:junit4]   2> 3113 T51 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:43697/solr
[junit4:junit4]   2> 3114 T51 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 3114 T51 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 3114 T51 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 3116 T51 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3117 T25 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 3118 T25 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 3133 T25 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 3203 T25 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 3207 T25 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:60081
[junit4:junit4]   2> 3208 T25 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 3209 T25 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355347375524
[junit4:junit4]   2> 3209 T25 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355347375524/'
[junit4:junit4]   2> 3231 T25 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 3231 T25 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 3232 T25 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355347375524
[junit4:junit4]   2> 3232 T25 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355347375524/solr.xml
[junit4:junit4]   2> 3233 T25 oasc.CoreContainer.<init> New CoreContainer 1597016763
[junit4:junit4]   2> 3233 T25 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355347375524/'
[junit4:junit4]   2> 3233 T25 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355347375524/'
[junit4:junit4]   2> 3252 T25 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 3266 T25 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:57274/solr
[junit4:junit4]   2> 3266 T25 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 3268 T25 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57274 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@f6fac55
[junit4:junit4]   2> 3270 T62 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:57274. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 3282 T25 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3285 T27 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:44012
[junit4:junit4]   2> 3286 T62 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:57274, initiating session
[junit4:junit4]   2> 3286 T27 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:44012
[junit4:junit4]   2> 3288 T29 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b90ffa9e80004 with negotiated timeout 20000 for client /127.0.0.1:44012
[junit4:junit4]   2> 3289 T62 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:57274, sessionid = 0x13b90ffa9e80004, negotiated timeout = 20000
[junit4:junit4]   2> 3292 T63 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f6fac55 name:ZooKeeperConnection Watcher:127.0.0.1:57274 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3292 T25 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3294 T30 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b90ffa9e80004
[junit4:junit4]   2> 3295 T27 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:44012 which had sessionid 0x13b90ffa9e80004
[junit4:junit4]   2> 3298 T63 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 3298 T25 oaz.ZooKeeper.close Session: 0x13b90ffa9e80004 closed
[junit4:junit4]   2> 3299 T25 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57274/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@d3d424c
[junit4:junit4]   2> 3301 T64 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:57274. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 3302 T64 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:57274, initiating session
[junit4:junit4]   2> 3302 T27 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:44013
[junit4:junit4]   2> 3302 T27 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:44013
[junit4:junit4]   2> 3302 T25 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3303 T29 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b90ffa9e80005 with negotiated timeout 8000 for client /127.0.0.1:44013
[junit4:junit4]   2> 3304 T64 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:57274, sessionid = 0x13b90ffa9e80005, negotiated timeout = 8000
[junit4:junit4]   2> 3304 T65 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d3d424c name:ZooKeeperConnection Watcher:127.0.0.1:57274/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3304 T25 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3306 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b90ffa9e80005 type:create cxid:0x1 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3307 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b90ffa9e80005 type:create cxid:0x2 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3309 T25 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60081_solr
[junit4:junit4]   2> 3309 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b90ffa9e80005 type:delete cxid:0x4 zxid:0x4c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:60081_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:60081_solr
[junit4:junit4]   2> 3310 T25 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:60081_solr
[junit4:junit4]   2> 3313 T48 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 3314 T48 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3314 T25 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 3315 T25 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 3315 T25 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 3316 T25 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 3316 T25 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 3317 T25 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 3317 T25 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 3318 T25 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 3318 T25 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 3319 T25 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 3327 T25 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3334 T66 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355347375524/collection1
[junit4:junit4]   2> 3334 T66 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 3335 T66 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 3335 T66 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 3336 T66 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355347375524/collection1/'
[junit4:junit4]   2> 3336 T66 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty1-1355347375524/collection1/lib/README' to classloader
[junit4:junit4]   2> 3337 T66 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty1-1355347375524/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 3406 T66 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 3475 T66 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 3476 T66 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 3522 T66 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 3583 T49 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3586 T49 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:43697_solr",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "shard":"control_shard",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:43697/solr",
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "operation":"state"}
[junit4:junit4]   2> 3593 T65 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3594 T48 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 4173 T66 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 4186 T66 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 4190 T66 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 4225 T66 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 4230 T66 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 4235 T66 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 4237 T66 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 4239 T66 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355347375524/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355347372396/jetty1/
[junit4:junit4]   2> 4239 T66 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@48783691
[junit4:junit4]   2> 4241 T66 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355347372396/jetty1/index/
[junit4:junit4]   2> 4242 T66 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355347372396/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 4242 T66 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355347372396/jetty1/index forceNew:false
[junit4:junit4]   2> 4253 T66 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355347372396/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6794ab50; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 4256 T66 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 4259 T66 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 4262 T66 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 4262 T66 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 4263 T66 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 4263 T66 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 4270 T66 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 4271 T66 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 4271 T66 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 4272 T66 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 4274 T66 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 4275 T66 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 4276 T66 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 4277 T66 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 4278 T66 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 4278 T66 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 4279 T66 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 4282 T66 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 4284 T66 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4285 T66 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4286 T66 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4287 T66 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4288 T66 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4289 T66 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4291 T66 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4297 T66 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 4325 T66 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 4329 T66 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 4331 T66 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 4333 T66 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [CURRENCY.XML, OLD_SYNONYMS.TXT, PROTWORDS.TXT, SYNONYMS.TXT, SCHEMA.XML, OPEN-EXCHANGE-RATES.JSON, STOPWORDS.TXT, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 4336 T66 oass.SolrIndexSearcher.<init> Opening Searcher@40030597 main
[junit4:junit4]   2> 4337 T66 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 4338 T66 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 4338 T66 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 4339 T66 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 4346 T66 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 4404 T67 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@40030597 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 4420 T66 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 4420 T66 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 4605 T49 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4607 T49 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:60081_solr",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:60081/solr",
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "operation":"state"}
[junit4:junit4]   2> 4607 T49 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4]   2> 4610 T49 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 4621 T65 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 4621 T48 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 4928 T66 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 4928 T66 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:60081/solr shardId:shard1
[junit4:junit4]   2> 4929 T66 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 4937 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b90ffa9e80005 type:delete cxid:0x45 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 4938 T66 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 4939 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b90ffa9e80005 type:create cxid:0x46 zxid:0x5d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4942 T66 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 4942 T66 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 4942 T66 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:60081/solr/collection1/
[junit4:junit4]   2> 4942 T66 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 4942 T66 oasc.SyncStrategy.syncToMe http://127.0.0.1:60081/solr/collection1/ has no replicas
[junit4:junit4]   2> 4943 T66 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:60081/solr/collection1/
[junit4:junit4]   2> 4943 T66 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 4948 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b90ffa9e80005 type:create cxid:0x50 zxid:0x61 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5129 T49 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5141 T48 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 5141 T65 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 5152 T66 oasc.ZkController.register We are http://127.0.0.1:60081/solr/collection1/ and leader is http://127.0.0.1:60081/solr/collection1/
[junit4:junit4]   2> 5153 T66 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:60081/solr
[junit4:junit4]   2> 5153 T66 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 5153 T66 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 5153 T66 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 5158 T66 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5160 T25 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 5160 T25 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 5161 T25 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 5234 T25 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 5239 T25 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:47833
[junit4:junit4]   2> 5241 T25 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 5241 T25 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355347377551
[junit4:junit4]   2> 5242 T25 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355347377551/'
[junit4:junit4]   2> 5260 T25 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 5261 T25 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 5262 T25 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355347377551
[junit4:junit4]   2> 5262 T25 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355347377551/solr.xml
[junit4:junit4]   2> 5262 T25 oasc.CoreContainer.<init> New CoreContainer 1003637583
[junit4:junit4]   2> 5262 T25 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355347377551/'
[junit4:junit4]   2> 5263 T25 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355347377551/'
[junit4:junit4]   2> 5284 T25 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 5297 T25 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:57274/solr
[junit4:junit4]   2> 5297 T25 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 5298 T25 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57274 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@6073d7f6
[junit4:junit4]   2> 5299 T25 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 5299 T77 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:57274. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 5300 T77 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:57274, initiating session
[junit4:junit4]   2> 5300 T27 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:44014
[junit4:junit4]   2> 5301 T27 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:44014
[junit4:junit4]   2> 5302 T29 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b90ffa9e80006 with negotiated timeout 20000 for client /127.0.0.1:44014
[junit4:junit4]   2> 5302 T77 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:57274, sessionid = 0x13b90ffa9e80006, negotiated timeout = 20000
[junit4:junit4]   2> 5302 T78 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6073d7f6 name:ZooKeeperConnection Watcher:127.0.0.1:57274 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 5303 T25 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 5306 T30 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b90ffa9e80006
[junit4:junit4]   2> 5307 T78 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 5307 T25 oaz.ZooKeeper.close Session: 0x13b90ffa9e80006 closed
[junit4:junit4]   2> 5307 T27 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:44014 which had sessionid 0x13b90ffa9e80006
[junit4:junit4]   2> 5307 T25 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57274/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@3721bf5a
[junit4:junit4]   2> 5308 T25 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 5309 T79 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:57274. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 5309 T79 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:57274, initiating session
[junit4:junit4]   2> 5309 T27 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:44015
[junit4:junit4]   2> 5310 T27 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:44015
[junit4:junit4]   2> 5311 T29 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b90ffa9e80007 with negotiated timeout 8000 for client /127.0.0.1:44015
[junit4:junit4]   2> 5311 T79 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:57274, sessionid = 0x13b90ffa9e80007, negotiated timeout = 8000
[junit4:junit4]   2> 5311 T80 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3721bf5a name:ZooKeeperConnection Watcher:127.0.0.1:57274/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 5311 T25 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 5313 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b90ffa9e80007 type:create cxid:0x1 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5315 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b90ffa9e80007 type:create cxid:0x2 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5317 T25 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47833_solr
[junit4:junit4]   2> 5317 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b90ffa9e80007 type:delete cxid:0x4 zxid:0x70 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:47833_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:47833_solr
[junit4:junit4]   2> 5318 T25 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:47833_solr
[junit4:junit4]   2> 5321 T65 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 5321 T48 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 5323 T48 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 5323 T25 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 5323 T65 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 5324 T25 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 5324 T25 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 5324 T25 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 5325 T25 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 5325 T25 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 5326 T25 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 5327 T25 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 5328 T25 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 5328 T25 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 5337 T25 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 5345 T81 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355347377551/collection1
[junit4:junit4]   2> 5345 T81 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 5346 T81 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 5346 T81 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 5347 T81 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355347377551/collection1/'
[junit4:junit4]   2> 5348 T81 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty2-1355347377551/collection1/lib/README' to classloader
[junit4:junit4]   2> 5348 T81 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty2-1355347377551/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 5434 T81 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 5489 T81 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 5490 T81 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 5498 T81 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 5651 T49 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5652 T49 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:60081_solr",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:60081/solr",
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "operation":"state"}
[junit4:junit4]   2> 5676 T48 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5677 T65 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5678 T80 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5920 T81 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 5929 T81 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 5931 T81 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 5958 T81 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5964 T81 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5976 T81 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5978 T81 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5983 T81 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355347377551/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355347372396/jetty2/
[junit4:junit4]   2> 5984 T81 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@48783691
[junit4:junit4]   2> 5984 T81 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355347372396/jetty2/index/
[junit4:junit4]   2> 5985 T81 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355347372396/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 5985 T81 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355347372396/jetty2/index forceNew:false
[junit4:junit4]   2> 5989 T81 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355347372396/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3f7476bd; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 5990 T81 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 5990 T81 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 5992 T81 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 5992 T81 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 5993 T81 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 5993 T81 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 5994 T81 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 5994 T81 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 5994 T81 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 5997 T81 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 6000 T81 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 6003 T81 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 6005 T81 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 6006 T81 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 6007 T81 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 6008 T81 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 6008 T81 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 6009 T81 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 6010 T81 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6011 T81 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6012 T81 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6013 T81 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6015 T81 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6016 T81 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6030 T81 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6031 T81 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 6033 T81 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 6037 T81 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 6039 T81 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 6041 T81 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [CURRENCY.XML, OLD_SYNONYMS.TXT, PROTWORDS.TXT, SYNONYMS.TXT, SCHEMA.XML, OPEN-EXCHANGE-RATES.JSON, STOPWORDS.TXT, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 6044 T81 oass.SolrIndexSearcher.<init> Opening Searcher@1a5e9dcc main
[junit4:junit4]   2> 6045 T81 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 6046 T81 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 6046 T81 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 6046 T81 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 6051 T81 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 6093 T82 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1a5e9dcc main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 6100 T81 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 6100 T81 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 6184 T49 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6186 T49 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:47833_solr",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:47833/solr",
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "operation":"state"}
[junit4:junit4]   2> 6186 T49 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 6186 T49 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4]   2> 6193 T48 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 6194 T80 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 6193 T65 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 6602 T81 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 6603 T81 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:47833/solr shardId:shard2
[junit4:junit4]   2> 6604 T81 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4]   2> 6614 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b90ffa9e80007 type:delete cxid:0x44 zxid:0x7f txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard2 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard2
[junit4:junit4]   2> 6615 T81 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 6616 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b90ffa9e80007 type:create cxid:0x45 zxid:0x80 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6619 T81 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 6619 T81 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 6620 T81 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:47833/solr/collection1/
[junit4:junit4]   2> 6620 T81 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 6620 T81 oasc.SyncStrategy.syncToMe http://127.0.0.1:47833/solr/collection1/ has no replicas
[junit4:junit4]   2> 6621 T81 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:47833/solr/collection1/
[junit4:junit4]   2> 6621 T81 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4]   2> 6626 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b90ffa9e80007 type:create cxid:0x4e zxid:0x83 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6700 T49 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6711 T65 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 6711 T80 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 6712 T48 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 6728 T81 oasc.ZkController.register We are http://127.0.0.1:47833/solr/collection1/ and leader is http://127.0.0.1:47833/solr/collection1/
[junit4:junit4]   2> 6728 T81 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:47833/solr
[junit4:junit4]   2> 6728 T81 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 6729 T81 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 6729 T81 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 6731 T81 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6732 T25 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 6733 T25 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 6733 T25 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 6802 T25 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 6809 T25 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:51678
[junit4:junit4]   2> 6810 T25 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 6811 T25 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355347379121
[junit4:junit4]   2> 6811 T25 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355347379121/'
[junit4:junit4]   2> 6830 T25 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 6831 T25 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 6831 T25 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355347379121
[junit4:junit4]   2> 6832 T25 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355347379121/solr.xml
[junit4:junit4]   2> 6832 T25 oasc.CoreContainer.<init> New CoreContainer 567967259
[junit4:junit4]   2> 6833 T25 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355347379121/'
[junit4:junit4]   2> 6833 T25 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355347379121/'
[junit4:junit4]   2> 6851 T25 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 6859 T25 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:57274/solr
[junit4:junit4]   2> 6860 T25 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 6860 T25 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57274 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@733e6b0b
[junit4:junit4]   2> 6862 T25 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6862 T92 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:57274. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 6863 T92 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:57274, initiating session
[junit4:junit4]   2> 6863 T27 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:44016
[junit4:junit4]   2> 6863 T27 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:44016
[junit4:junit4]   2> 6864 T29 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b90ffa9e80008 with negotiated timeout 20000 for client /127.0.0.1:44016
[junit4:junit4]   2> 6865 T92 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:57274, sessionid = 0x13b90ffa9e80008, negotiated timeout = 20000
[junit4:junit4]   2> 6865 T93 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@733e6b0b name:ZooKeeperConnection Watcher:127.0.0.1:57274 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6866 T25 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6867 T30 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b90ffa9e80008
[junit4:junit4]   2> 6869 T93 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 6869 T27 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:44016 which had sessionid 0x13b90ffa9e80008
[junit4:junit4]   2> 6868 T25 oaz.ZooKeeper.close Session: 0x13b90ffa9e80008 closed
[junit4:junit4]   2> 6869 T25 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57274/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@7b4cdeb0
[junit4:junit4]   2> 6870 T25 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6870 T94 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:57274. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 6871 T94 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:57274, initiating session
[junit4:junit4]   2> 6871 T27 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:44017
[junit4:junit4]   2> 6872 T27 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:44017
[junit4:junit4]   2> 6872 T29 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b90ffa9e80009 with negotiated timeout 8000 for client /127.0.0.1:44017
[junit4:junit4]   2> 6872 T94 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:57274, sessionid = 0x13b90ffa9e80009, negotiated timeout = 8000
[junit4:junit4]   2> 6873 T95 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7b4cdeb0 name:ZooKeeperConnection Watcher:127.0.0.1:57274/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6873 T25 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6876 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b90ffa9e80009 type:create cxid:0x1 zxid:0x90 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6878 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b90ffa9e80009 type:create cxid:0x2 zxid:0x91 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6879 T25 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51678_solr
[junit4:junit4]   2> 6880 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b90ffa9e80009 type:delete cxid:0x4 zxid:0x92 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:51678_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:51678_solr
[junit4:junit4]   2> 6881 T25 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51678_solr
[junit4:junit4]   2> 6883 T65 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 6883 T48 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 6884 T48 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6886 T80 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 6886 T25 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 6886 T80 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6886 T25 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 6887 T25 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 6887 T25 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 6888 T65 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 6888 T25 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 6888 T25 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 6888 T25 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 6889 T25 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 6889 T25 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 6889 T25 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 6895 T25 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 6903 T96 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355347379121/collection1
[junit4:junit4]   2> 6903 T96 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 6906 T96 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 6906 T96 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 6908 T96 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355347379121/collection1/'
[junit4:junit4]   2> 6910 T96 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty3-1355347379121/collection1/lib/README' to classloader
[junit4:junit4]   2> 6911 T96 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty3-1355347379121/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 6967 T96 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 7036 T96 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 7038 T96 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 7052 T96 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 7218 T49 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7220 T49 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:47833_solr",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:47833/solr",
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "operation":"state"}
[junit4:junit4]   2> 7225 T80 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 7225 T65 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 7225 T48 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 7229 T95 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 7584 T96 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 7595 T96 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 7597 T96 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 7627 T96 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 7633 T96 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 7637 T96 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 7640 T96 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 7642 T96 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355347379121/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355347372396/jetty3/
[junit4:junit4]   2> 7642 T96 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@48783691
[junit4:junit4]   2> 7643 T96 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355347372396/jetty3/index/
[junit4:junit4]   2> 7644 T96 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355347372396/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 7644 T96 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355347372396/jetty3/index forceNew:false
[junit4:junit4]   2> 7650 T96 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355347372396/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@560eb78f; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 7650 T96 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 7651 T96 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 7656 T96 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 7657 T96 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 7657 T96 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 7657 T96 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 7658 T96 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 7658 T96 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 7659 T96 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 7663 T96 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 7665 T96 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 7666 T96 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 7667 T96 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 7668 T96 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 7669 T96 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 7669 T96 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 7671 T96 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 7672 T96 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 7677 T96 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7686 T96 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7688 T96 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7689 T96 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7690 T96 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7691 T96 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7692 T96 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7693 T96 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 7701 T96 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 7705 T96 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 7707 T96 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 7713 T96 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [CURRENCY.XML, OLD_SYNONYMS.TXT, PROTWORDS.TXT, SYNONYMS.TXT, SCHEMA.XML, OPEN-EXCHANGE-RATES.JSON, STOPWORDS.TXT, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 7738 T96 oass.SolrIndexSearcher.<init> Opening Searcher@65237243 main
[junit4:junit4]   2> 7739 T96 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 7740 T96 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 7740 T96 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 7740 T96 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 7748 T96 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 7785 T97 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@65237243 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 7795 T96 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 7796 T96 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 8232 T49 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8233 T49 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:51678_solr",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:51678/solr",
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "operation":"state"}
[junit4:junit4]   2> 8233 T49 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 8234 T49 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 8242 T48 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 8242 T95 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 8242 T65 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 8242 T80 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 8300 T96 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 8300 T96 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:51678/solr shardId:shard1
[junit4:junit4]   2> 8305 T96 oasc.ZkController.register We are http://127.0.0.1:51678/solr/collection1/ and leader is http://127.0.0.1:60081/solr/collection1/
[junit4:junit4]   2> 8306 T96 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51678/solr
[junit4:junit4]   2> 8306 T96 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 8306 T96 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C1 name=collection1 org.apache.solr.core.SolrCore@713eb015 url=http://127.0.0.1:51678/solr/collection1 node=127.0.0.1:51678_solr
[junit4:junit4]   2> 8310 T98 C1 P51678 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 8311 T96 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8312 T98 C1 P51678 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 8313 T98 C1 P51678 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 8313 T98 C1 P51678 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 8315 T98 C1 P51678 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:60081/solr/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 8319 T98 C1 P51678 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4]   2> 8321 T25 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 8322 T25 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 8322 T25 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 8325 T98 C1 P51678 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:51678/solr START replicas=[http://127.0.0.1:60081/solr/collection1/] nUpdates=100
[junit4:junit4]   2> 8327 T98 C1 P51678 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 8328 T98 C1 P51678 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 8328 T98 C1 P51678 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 8328 T98 C1 P51678 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 8384 T25 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 8387 T25 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:58633
[junit4:junit4]   2> 8389 T25 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 8390 T25 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355347380710
[junit4:junit4]   2> 8390 T25 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355347380710/'
[junit4:junit4]   2> 8411 T25 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 8412 T25 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 8412 T25 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355347380710
[junit4:junit4]   2> 8413 T25 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355347380710/solr.xml
[junit4:junit4]   2> 8413 T25 oasc.CoreContainer.<init> New CoreContainer 306376412
[junit4:junit4]   2> 8414 T25 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355347380710/'
[junit4:junit4]   2> 8414 T25 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355347380710/'
[junit4:junit4]   2> 8434 T25 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 8446 T25 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:57274/solr
[junit4:junit4]   2> 8447 T25 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 8448 T25 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57274 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1705a920
[junit4:junit4]   2> 8449 T25 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 8449 T109 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:57274. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 8450 T109 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:57274, initiating session
[junit4:junit4]   2> 8450 T27 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:44018
[junit4:junit4]   2> 8450 T27 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:44018
[junit4:junit4]   2> 8452 T29 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b90ffa9e8000a with negotiated timeout 20000 for client /127.0.0.1:44018
[junit4:junit4]   2> 8453 T109 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:57274, sessionid = 0x13b90ffa9e8000a, negotiated timeout = 20000
[junit4:junit4]   2> 8457 T110 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1705a920 name:ZooKeeperConnection Watcher:127.0.0.1:57274 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 8458 T25 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 8462 T30 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b90ffa9e8000a
[junit4:junit4]   2> 8463 T25 oaz.ZooKeeper.close Session: 0x13b90ffa9e8000a closed
[junit4:junit4]   2> 8463 T110 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 8463 T27 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:44018 which had sessionid 0x13b90ffa9e8000a
[junit4:junit4]   2> 8464 T25 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57274/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@2afacf55
[junit4:junit4]   2> 8465 T111 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:57274. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 8465 T25 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 8466 T27 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:44019
[junit4:junit4]   2> 8466 T111 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:57274, initiating session
[junit4:junit4]   2> 8466 T27 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:44019
[junit4:junit4]   2> 8473 T29 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b90ffa9e8000b with negotiated timeout 8000 for client /127.0.0.1:44019
[junit4:junit4]   2> 8473 T111 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:57274, sessionid = 0x13b90ffa9e8000b, negotiated timeout = 8000
[junit4:junit4]   2> 8474 T112 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2afacf55 name:ZooKeeperConnection Watcher:127.0.0.1:57274/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 8474 T25 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 8475 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b90ffa9e8000b type:create cxid:0x1 zxid:0xa3 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 8477 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b90ffa9e8000b type:create cxid:0x2 zxid:0xa4 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 8479 T25 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58633_solr
[junit4:junit4]   2> 8480 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b90ffa9e8000b type:delete cxid:0x4 zxid:0xa5 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:58633_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:58633_solr
[junit4:junit4]   2> 8480 T25 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:58633_solr
[junit4:junit4]   2> 8483 T48 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 8483 T95 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 8483 T80 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 8483 T65 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 8484 T65 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8486 T48 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 8486 T80 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 8486 T95 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 8490 T25 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 8490 T25 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 8491 T25 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 8491 T25 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 8492 T25 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 8492 T25 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 8493 T25 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 8493 T25 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 8494 T25 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 8494 T25 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 8504 T25 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 8528 T113 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355347380710/collection1
[junit4:junit4]   2> 8528 T113 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 8529 T113 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 8543 T113 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 8545 T113 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355347380710/collection1/'
[junit4:junit4]   2> 8545 T113 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty4-1355347380710/collection1/lib/README' to classloader
[junit4:junit4]   2> 8546 T113 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty4-1355347380710/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 8597 T113 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 8662 T113 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 8663 T113 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 8668 T113 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> ASYNC  NEW_CORE C2 name=collection1 org.apache.solr.core.SolrCore@17e7c123 url=http://127.0.0.1:60081/solr/collection1 node=127.0.0.1:60081_solr
[junit4:junit4]   2> 8690 T58 C2 P60081 REQ /get {distrib=false&version=2&getVersions=100&qt=/get&wt=javabin} status=0 QTime=4 
[junit4:junit4]   2> 8748 T49 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8749 T49 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:51678_solr",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:51678/solr",
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "operation":"state"}
[junit4:junit4]   2> 8756 T80 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8756 T112 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8756 T65 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8756 T48 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8757 T95 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9135 T113 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 9146 T113 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 9149 T113 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 9171 T113 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 9181 T113 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 9185 T113 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 9188 T113 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 9210 T113 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355347380710/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355347372396/jetty4/
[junit4:junit4]   2> 9211 T113 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@48783691
[junit4:junit4]   2> 9215 T113 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355347372396/jetty4/index/
[junit4:junit4]   2> 9216 T113 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355347372396/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 9216 T113 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355347372396/jetty4/index forceNew:false
[junit4:junit4]   2> 9225 T113 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355347372396/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@2aa99381; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 9228 T113 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 9229 T113 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 9231 T113 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 9231 T113 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 9232 T113 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 9232 T113 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 9233 T113 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 9233 T113 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 9234 T113 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 9235 T113 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 9236 T113 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 9237 T113 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 9238 T113 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 9238 T113 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 9240 T113 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 9240 T113 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 9240 T113 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 9241 T113 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 9242 T113 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9243 T113 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9244 T113 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9245 T113 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9246 T113 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9247 T113 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9249 T113 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9250 T113 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 9251 T113 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 9255 T113 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 9257 T113 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 9259 T113 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [CURRENCY.XML, OLD_SYNONYMS.TXT, PROTWORDS.TXT, SYNONYMS.TXT, SCHEMA.XML, OPEN-EXCHANGE-RATES.JSON, STOPWORDS.TXT, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 9261 T113 oass.SolrIndexSearcher.<init> Opening Searcher@6dfc7502 main
[junit4:junit4]   2> 9262 T113 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 9263 T113 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 9263 T113 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 9263 T113 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 9267 T113 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 9302 T114 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6dfc7502 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 9321 T113 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 9322 T113 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 9767 T49 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9768 T49 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:58633_solr",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:58633/solr",
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "operation":"state"}
[junit4:junit4]   2> 9769 T49 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 9769 T49 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4]   2> 9775 T95 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9775 T112 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9775 T48 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9775 T65 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9775 T80 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9824 T113 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 9824 T113 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:58633/solr shardId:shard2
[junit4:junit4]   2> 9827 T113 oasc.ZkController.register We are http://127.0.0.1:58633/solr/collection1/ and leader is http://127.0.0.1:47833/solr/collection1/
[junit4:junit4]   2> 9828 T113 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:58633/solr
[junit4:junit4]   2> 9828 T113 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 9828 T113 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C3 name=collection1 org.apache.solr.core.SolrCore@6eb97bf7 url=http://127.0.0.1:58633/solr/collection1 node=127.0.0.1:58633_solr
[junit4:junit4]   2> 9829 T115 C3 P58633 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 9829 T115 C3 P58633 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 9829 T115 C3 P58633 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 9830 T115 C3 P58633 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 9830 T113 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9831 T115 C3 P58633 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:47833/solr/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 9832 T115 C3 P58633 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:58633/solr START replicas=[http://127.0.0.1:47833/solr/collection1/] nUpdates=100
[junit4:junit4]   2> 9832 T115 C3 P58633 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 9832 T25 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 9833 T25 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 9833 T25 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 9834 T115 C3 P58633 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 9834 T115 C3 P58633 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 9834 T115 C3 P58633 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C4 name=collection1 org.apache.solr.core.SolrCore@53a29fa3 url=http://127.0.0.1:47833/solr/collection1 node=127.0.0.1:47833_solr
[junit4:junit4]   2> 9843 T75 C4 P47833 REQ /get {distrib=false&version=2&getVersions=100&qt=/get&wt=javabin} status=0 QTime=3 
[junit4:junit4]   2> 9844 T25 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57274/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@3ee98e03
[junit4:junit4]   2> 9847 T117 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:57274. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 9847 T25 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 9848 T27 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:44032
[junit4:junit4]   2> 9847 T117 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:57274, initiating session
[junit4:junit4]   2> 9849 T27 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:44032
[junit4:junit4]   2> 9850 T29 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b90ffa9e8000c with negotiated timeout 10000 for client /127.0.0.1:44032
[junit4:junit4]   2> 9852 T117 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:57274, sessionid = 0x13b90ffa9e8000c, negotiated timeout = 10000
[junit4:junit4]   2> 9852 T118 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3ee98e03 name:ZooKeeperConnection Watcher:127.0.0.1:57274/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 9853 T25 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 9854 T25 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 9857 T25 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 9858 T25 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 9863 T25 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9866 T25 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):540
[junit4:junit4]   2> 9867 T25 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10282 T49 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10283 T49 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:58633_solr",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:58633/solr",
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "operation":"state"}
[junit4:junit4]   2> 10291 T118 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10291 T48 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10291 T80 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10291 T112 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10291 T65 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10291 T95 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10869 T25 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2>  C1_STATE=coll:collection1 core:collection1 props:{node_name=127.0.0.1:51678_solr, collection=collection1, core=collection1, roles=null, shard=shard1, base_url=http://127.0.0.1:51678/solr, state=recovering}
[junit4:junit4]   2> 11689 T98 C1 P51678 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 11690 T98 C1 P51678 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 11690 T98 C1 P51678 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:60081/solr/collection1/. core=collection1
[junit4:junit4]   2> 11691 T98 C1 P51678 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 11702 T61 C2 P60081 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16
[junit4:junit4]   2> 11707 T61 C2 P60081 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 11711 T61 C2 P60081 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355347372396/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6794ab50; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 11712 T61 C2 P60081 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 11724 T61 C2 P60081 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355347372396/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6794ab50; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355347372396/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6794ab50; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 11725 T61 C2 P60081 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 11725 T61 C2 P60081 oass.SolrIndexSearcher.<init> Opening Searcher@532bcc1c realtime
[junit4:junit4]   2> 11726 T61 C2 P60081 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 11726 T61 C2 P60081 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 11726 T61 C2 P60081 /update {commit_end_point=true&version=2&openSearcher=false&waitSearcher=true&commit=true&softCommit=false&wt=javabin} {commit=} 0 27
[junit4:junit4]   2> 11750 T98 C1 P51678 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 11754 T98 C1 P51678 oascsi.HttpClientUtil.createClient Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
[junit4:junit4]   2> 11761 T98 C1 P51678 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 11782 T58 C2 P60081 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 11783 T58 C2 P60081 REQ /replication {command=indexversion&version=2&qt=/replication&wt=javabin} status=0 QTime=20 
[junit4:junit4]   2> 11784 T98 C1 P51678 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 11785 T98 C1 P51678 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 11785 T98 C1 P51678 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 11789 T59 C2 P60081 REQ /replication {command=filelist&version=2&generation=2&qt=/replication&wt=javabin} status=0 QTime=1 
[junit4:junit4]   2> 11791 T98 C1 P51678 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 11793 T98 C1 P51678 oash.SnapPuller.fetchLatestIndex Starting download to ./org.apache.solr.cloud.BasicDistributedZkTest-1355347372396/jetty3/index.20121213052304176 fullCopy=true
[junit4:junit4]   2> 11808 T60 C2 P60081 REQ /replication {command=filecontent&checksum=true&generation=2&qt=/replication&file=segments_2&wt=filestream} status=0 QTime=3 
[junit4:junit4]   2> 11815 T98 C1 P51678 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 11825 T98 C1 P51678 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20121213052304176
[junit4:junit4]   2> 11834 T98 C1 P51678 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.BasicDistributedZkTest-1355347372396/jetty3/index/ new=./org.apache.solr.cloud.BasicDistributedZkTest-1355347372396/jetty3/index.20121213052304176
[junit4:junit4]   2> 11837 T98 C1 P51678 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355347372396/jetty3/index.20121213052304176 forceNew:false
[junit4:junit4]   2> 11840 T98 C1 P51678 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355347372396/jetty3/index.20121213052304176 lockFactory=org.apache.lucene.store.NativeFSLockFactory@77cdc895; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 11840 T98 C1 P51678 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 11843 T98 C1 P51678 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 11845 T98 C1 P51678 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 11846 T98 C1 P51678 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4]   2> 11847 T98 C1 P51678 oasc.CachingDirectoryFactory.close Closing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355347372396/jetty3/index.20121213052304176
[junit4:junit4]   2> 11848 T98 C1 P51678 oash.SnapPuller$2.onClose removing old index directory ./org.apache.solr.cloud.BasicDistributedZkTest-1355347372396/jetty3/index
[junit4:junit4]   2> 11850 T98 C1 P51678 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355347372396/jetty3/index.20121213052304176 forceNew:true
[junit4:junit4]   2> 11854 T98 C1 P51678 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355347372396/jetty3/index.20121213052304176 lockFactory=org.apache.lucene.store.NativeFSLockFactory@66d7e31d; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 11854 T98 C1 P51678 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 11854 T98 C1 P51678 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 11855 T98 C1 P51678 oass.SolrIndexSearcher.<init> Opening Searcher@72767cfb main
[junit4:junit4]   2> 11871 T25 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 11873 T98 C1 P51678 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 11879 T97 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@72767cfb main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 11880 T98 C1 P51678 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 11896 T98 C1 P51678 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355347372396/jetty3/index.20121213052304176 lockFactory=org.apache.lucene.store.NativeFSLockFactory@66d7e31d; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355347372396/jetty3/index.20121213052304176 lockFactory=org.apache.lucene.store.NativeFSLockFactory@66d7e31d; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 11896 T98 C1 P51678 oasc.SolrDeletionPolicy.updateCommits newest commit = 3
[junit4:junit4]   2> 11897 T98 C1 P51678 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 11900 T98 C1 P51678 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 11901 T98 C1 P51678 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 11902 T98 C1 P51678 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 11902 T98 C1 P51678 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 11904 T98 C1 P51678 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 12307 T49 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 12308 T49 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:51678_solr",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:51678/solr",
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "operation":"state"}
[junit4:junit4]   2> 12314 T65 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 12314 T48 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 12315 T118 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 12314 T112 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 12314 T80 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 12314 T95 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2>  C3_STATE=coll:collection1 core:collection1 props:{node_name=127.0.0.1:58633_solr, collection=collection1, core=collection1, roles=null, shard=shard2, base_url=http://127.0.0.1:58633/solr, state=recovering}
[junit4:junit4]   2> 12845 T115 C3 P58633 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 12846 T115 C3 P58633 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 12846 T115 C3 P58633 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:47833/solr/collection1/. core=collection1
[junit4:junit4]   2> 12846 T115 C3 P58633 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 12851 T74 C4 P47833 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 12854 T74 C4 P47833 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355347372396/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3f7476bd; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 12855 T74 C4 P47833 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 12864 T74 C4 P47833 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355347372396/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3f7476bd; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355347372396/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3f7476bd; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 12865 T74 C4 P47833 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 12866 T74 C4 P47833 oass.SolrIndexSearcher.<init> Opening Searcher@b653a31 realtime
[junit4:junit4]   2> 12866 T74 C4 P47833 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 12867 T74 C4 P47833 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 12867 T74 C4 P47833 /update {commit_end_point=true&version=2&openSearcher=false&waitSearcher=true&commit=true&softCommit=false&wt=javabin} {commit=} 0 16
[junit4:junit4]   2> 12869 T115 C3 P58633 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 12870 T115 C3 P58633 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 12872 T75 C4 P47833 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 12873 T75 C4 P47833 REQ /replication {command=indexversion&version=2&qt=/replication&wt=javabin} status=0 QTime=2 
[junit4:junit4]   2> 12874 T115 C3 P58633 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 12874 T115 C3 P58633 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 12874 T115 C3 P58633 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 12876 T25 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 12878 T74 C4 P47833 REQ /replication {command=filelist&version=2&generation=2&qt=/replication&wt=javabin} status=0 QTime=1 
[junit4:junit4]   2> 12879 T115 C3 P58633 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 12879 T115 C3 P58633 oash.SnapPuller.fetchLatestIndex Starting download to ./org.apache.solr.cloud.BasicDistributedZkTest-1355347372396/jetty4/index.20121213052305264 fullCopy=true
[junit4:junit4]   2> 12887 T76 C4 P47833 REQ /replication {command=filecontent&checksum=true&generation=2&qt=/replication&file=segments_2&wt=filestream} status=0 QTime=1 
[junit4:junit4]   2> 12889 T115 C3 P58633 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 12894 T115 C3 P58633 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20121213052305264
[junit4:junit4]   2> 12895 T115 C3 P58633 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.BasicDistributedZkTest-1355347372396/jetty4/index/ new=./org.apache.solr.cloud.BasicDistributedZkTest-1355347372396/jetty4/index.20121213052305264
[junit4:junit4]   2> 12896 T115 C3 P58633 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355347372396/jetty4/index.20121213052305264 forceNew:false
[junit4:junit4]   2> 12897 T115 C3 P58633 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355347372396/jetty4/index.20121213052305264 lockFactory=org.apache.lucene.store.NativeFSLockFactory@75c50969; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 12898 T115 C3 P58633 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 12898 T115 C3 P58633 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 12898 T115 C3 P58633 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 12899 T115 C3 P58633 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4]   2> 12899 T115 C3 P58633 oasc.CachingDirectoryFactory.close Closing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355347372396/jetty4/index.20121213052305264
[junit4:junit4]   2> 12899 T115 C3 P58633 oash.SnapPuller$2.onClose removing old index directory ./org.apache.solr.cloud.BasicDistributedZkTest-1355347372396/jetty4/index
[junit4:junit4]   2> 12900 T115 C3 P58633 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355347372396/jetty4/index.20121213052305264 forceNew:true
[junit4:junit4]   2> 12902 T115 C3 P58633 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355347372396/jetty4/index.20121213052305264 lockFactory=org.apache.lucene.store.NativeFSLockFactory@17a04197; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 12902 T115 C3 P58633 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 12902 T115 C3 P58633 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 12903 T115 C3 P58633 oass.SolrIndexSearcher.<init> Opening Searcher@540f8828 main
[junit4:junit4]   2> 12903 T115 C3 P58633 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 12910 T114 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@540f8828 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 12916 T115 C3 P58633 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 12946 T115 C3 P58633 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355347372396/jetty4/index.20121213052305264 lockFactory=org.apache.lucene.store.NativeFSLockFactory@17a04197; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355347372396/jetty4/index.20121213052305264 lockFactory=org.apache.lucene.store.NativeFSLockFactory@17a04197; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 12946 T115 C3 P58633 oasc.SolrDeletionPolicy.updateCommits newest commit = 3
[junit4:junit4]   2> 12947 T115 C3 P58633 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 12947 T115 C3 P58633 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 12947 T115 C3 P58633 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 12947 T115 C3 P58633 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 12947 T115 C3 P58633 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 12949 T115 C3 P58633 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 13324 T49 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 13325 T49 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:58633_solr",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:58633/solr",
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "operation":"state"}
[junit4:junit4]   2> 13335 T118 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 13335 T48 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 13335 T95 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 13335 T65 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 13335 T112 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 13335 T80 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 13879 T25 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> ASYNC  NEW_CORE C5 name=collection1 org.apache.solr.core.SolrCore@74626b21 url=http://127.0.0.1:43697/solr/collection1 node=127.0.0.1:43697_solr
[junit4:junit4]   2> 13917 T44 C5 P43697 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355347372396/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@23377225; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 13918 T44 C5 P43697 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 13926 T44 C5 P43697 oass.SolrIndexSearcher.<init> Opening Searcher@57d98133 realtime
[junit4:junit4]   2> 13927 T44 C5 P43697 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 13928 T44 C5 P43697 /update {version=2&wt=javabin} {deleteByQuery=*:* (-1421184740931665920)} 0 27
[junit4:junit4]   2> 13929 T25 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57274/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@37386741
[junit4:junit4]   2> 13930 T25 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 13930 T121 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:57274. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 13930 T121 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:57274, initiating session
[junit4:junit4]   2> 13931 T27 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:44039
[junit4:junit4]   2> 13931 T27 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:44039
[junit4:junit4]   2> 13932 T29 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b90ffa9e8000d with negotiated timeout 10000 for client /127.0.0.1:44039
[junit4:junit4]   2> 13932 T121 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:57274, sessionid = 0x13b90ffa9e8000d, negotiated timeout = 10000
[junit4:junit4]   2> 13932 T122 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@37386741 name:ZooKeeperConnection Watcher:127.0.0.1:57274/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 13933 T25 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 13934 T25 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2>  C3_STATE=coll:collection1 core:collection1 props:{node_name=127.0.0.1:58633_solr, collection=collection1, core=collection1, roles=null, shard=shard2, base_url=http://127.0.0.1:58633/solr, state=active}
[junit4:junit4]   2> 13966 T106 C3 P58633 REQ /update {update.from=http://127.0.0.1:47833/solr/collection1/&update.distrib=FROMLEADER&version=2&_version_=-1421184740979900416&wt=javabin} status=0 QTime=1 
[junit4:junit4]   2>  C1_STATE=coll:collection1 core:collection1 props:{node_name=127.0.0.1:51678_solr, collection=collection1, core=collection1, roles=null, shard=shard1, base_url=http://127.0.0.1:51678/solr, state=active}
[junit4:junit4]   2> 13968 T87 C1 P51678 REQ /update {update.from=http://127.0.0.1:60081/solr/collection1/&update.distrib=FROMLEADER&version=2&_version_=-1421184740965220352&wt=javabin} sta

[...truncated too long message...]

nit4:junit4]    > Throwable #1: java.lang.AssertionError: There are still nodes recoverying - waited for 540 seconds
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([5D02DE20BB4242EB:DCE45038CC1D22D7]:0)
[junit4:junit4]    > 	at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:165)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:115)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:110)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:563)
[junit4:junit4]    > 	at org.apache.solr.cloud.BasicDistributedZk2Test.brindDownShardIndexSomeDocsAndRecover(BasicDistributedZk2Test.java:321)
[junit4:junit4]    > 	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:83)
[junit4:junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:474)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 567649 T1008 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> NOTE: test params are: codec=Lucene41: {_version_=Pulsing41(freqCutoff=17 minBlockSize=19 maxBlockSize=117), a_si=Pulsing41(freqCutoff=17 minBlockSize=19 maxBlockSize=117), n_td1=Pulsing41(freqCutoff=17 minBlockSize=19 maxBlockSize=117), n_tf1=PostingsFormat(name=NestedPulsing), timestamp=PostingsFormat(name=NestedPulsing), text=PostingsFormat(name=TestBloomFilteredLucene41Postings), multiDefault=PostingsFormat(name=NestedPulsing), n_f1=Pulsing41(freqCutoff=17 minBlockSize=19 maxBlockSize=117), n_tdt1=Pulsing41(freqCutoff=17 minBlockSize=19 maxBlockSize=117), a_t=PostingsFormat(name=NestedPulsing), foo_d=PostingsFormat(name=Asserting), range_facet_l=PostingsFormat(name=NestedPulsing), range_facet_sl=PostingsFormat(name=Asserting), foo_b=PostingsFormat(name=TestBloomFilteredLucene41Postings), n_d1=PostingsFormat(name=NestedPulsing), oddField_s=PostingsFormat(name=Asserting), other_tl1=Pulsing41(freqCutoff=17 minBlockSize=19 maxBlockSize=117), n_ti1=PostingsFormat(name=Asserting), foo_f=PostingsFormat(name=TestBloomFilteredLucene41Postings), SubjectTerms_mfacet=Pulsing41(freqCutoff=17 minBlockSize=19 maxBlockSize=117), intDefault=Pulsing41(freqCutoff=17 minBlockSize=19 maxBlockSize=117), n_l1=PostingsFormat(name=NestedPulsing), range_facet_si=PostingsFormat(name=NestedPulsing), rnd_b=PostingsFormat(name=Asserting), n_tl1=Pulsing41(freqCutoff=17 minBlockSize=19 maxBlockSize=117), id=PostingsFormat(name=Asserting), n_dt1=Pulsing41(freqCutoff=17 minBlockSize=19 maxBlockSize=117)}, sim=DefaultSimilarity, locale=nl, timezone=Australia/Melbourne
[junit4:junit4]   2> NOTE: Linux 3.2.0-34-generic amd64/Oracle Corporation 1.8.0-ea (64-bit)/cpus=8,threads=2,free=80665968,total=290516992
[junit4:junit4]   2> NOTE: All tests run in this JVM: [WordBreakSolrSpellCheckerTest, TestSearchPerf, SearchHandlerTest, BasicDistributedZkTest, TestWordDelimiterFilterFactory, FastVectorHighlighterTest, SolrPluginUtilsTest, CacheHeaderTest, TestCollationField, SpellPossibilityIteratorTest, JsonLoaderTest, PreAnalyzedFieldTest, TestExtendedDismaxParser, TestPseudoReturnFields, TestFastWriter, TestFaceting, SampleTest, FieldAnalysisRequestHandlerTest, TestQuerySenderNoQuery, TestLMJelinekMercerSimilarityFactory, TestConfig, TestAnalyzedSuggestions, MoreLikeThisHandlerTest, TestFastLRUCache, TestNumberUtils, TestRangeQuery, PluginInfoTest, SolrRequestParserTest, SpatialFilterTest, DateMathParserTest, TestLMDirichletSimilarityFactory, TestStressLucene, DirectUpdateHandlerOptimizeTest, ClusterStateTest, AutoCommitTest, SpellCheckCollatorTest, TestSolr4Spatial, AlternateDirectoryTest, BinaryUpdateRequestHandlerTest, FileBasedSpellCheckerTest, MinimalSchemaTest, OverseerCollectionProcessorTest, TestGroupingSearch, BasicDistributedZk2Test]
[junit4:junit4] Completed on J0 in 567.68s, 1 test, 1 failure <<< FAILURES!

[...truncated 44 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:352: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:178: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:438: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1175: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:839: There were test failures: 239 suites, 994 tests, 1 error, 1 failure, 7 ignored (2 assumptions)

Total time: 34 minutes 10 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 64bit/jdk1.8.0-ea-b65 -XX:+UseConcMarkSweepGC
Email was triggered for: Failure
Sending email for trigger: Failure



Re: [JENKINS] Lucene-Solr-4.x-Linux (32bit/jdk1.6.0_37) - Build # 3189 - Still Failing!

Posted by Robert Muir <rc...@gmail.com>.
3.x codec i think.... it also got Thai

On Wed, Dec 12, 2012 at 3:21 PM, Policeman Jenkins Server
<je...@sd-datasolutions.de> wrote:
> Build: http://jenkins.sd-datasolutions.de/job/Lucene-Solr-4.x-Linux/3189/
> Java: 32bit/jdk1.6.0_37 -server -XX:+UseParallelGC
>
> 1 tests failed.
> REGRESSION:  org.apache.lucene.codecs.compressing.TestCompressingStoredFieldsFormat.testDeletePartiallyWrittenFilesIfAbort
>
> Error Message:
> expected:<2> but was:<0>
>
> Stack Trace:
> java.lang.AssertionError: expected:<2> but was:<0>
>         at __randomizedtesting.SeedInfo.seed([3CD76ABF62B468ED:63F777E803714901]:0)
>         at org.junit.Assert.fail(Assert.java:93)
>         at org.junit.Assert.failNotEquals(Assert.java:647)
>         at org.junit.Assert.assertEquals(Assert.java:128)
>         at org.junit.Assert.assertEquals(Assert.java:472)
>         at org.junit.Assert.assertEquals(Assert.java:456)
>         at org.apache.lucene.codecs.compressing.TestCompressingStoredFieldsFormat.testDeletePartiallyWrittenFilesIfAbort(TestCompressingStoredFieldsFormat.java:398)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>         at java.lang.reflect.Method.invoke(Method.java:597)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:841)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
>         at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
>         at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
>         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
>         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
>         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
>         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>         at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
>         at java.lang.Thread.run(Thread.java:662)
>
>
>
>
> Build Log:
> [...truncated 300 lines...]
> [junit4:junit4] Suite: org.apache.lucene.codecs.compressing.TestCompressingStoredFieldsFormat
> [junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestCompressingStoredFieldsFormat -Dtests.method=testDeletePartiallyWrittenFilesIfAbort -Dtests.seed=3CD76ABF62B468ED -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=th -Dtests.timezone=Africa/Cairo -Dtests.file.encoding=ISO-8859-1
> [junit4:junit4] FAILURE 0.03s J0 | TestCompressingStoredFieldsFormat.testDeletePartiallyWrittenFilesIfAbort <<<
> [junit4:junit4]    > Throwable #1: java.lang.AssertionError: expected:<2> but was:<0>
> [junit4:junit4]    >    at __randomizedtesting.SeedInfo.seed([3CD76ABF62B468ED:63F777E803714901]:0)
> [junit4:junit4]    >    at org.junit.Assert.fail(Assert.java:93)
> [junit4:junit4]    >    at org.junit.Assert.failNotEquals(Assert.java:647)
> [junit4:junit4]    >    at org.junit.Assert.assertEquals(Assert.java:128)
> [junit4:junit4]    >    at org.junit.Assert.assertEquals(Assert.java:472)
> [junit4:junit4]    >    at org.junit.Assert.assertEquals(Assert.java:456)
> [junit4:junit4]    >    at org.apache.lucene.codecs.compressing.TestCompressingStoredFieldsFormat.testDeletePartiallyWrittenFilesIfAbort(TestCompressingStoredFieldsFormat.java:398)
> [junit4:junit4]    >    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> [junit4:junit4]    >    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> [junit4:junit4]    >    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> [junit4:junit4]    >    at java.lang.reflect.Method.invoke(Method.java:597)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:841)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
> [junit4:junit4]    >    at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
> [junit4:junit4]    >    at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> [junit4:junit4]    >    at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> [junit4:junit4]    >    at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> [junit4:junit4]    >    at java.lang.Thread.run(Thread.java:662)
> [junit4:junit4] IGNOR/A 0.00s J0 | TestCompressingStoredFieldsFormat.testBigDocuments
> [junit4:junit4]    > Assumption #1: 'nightly' test group is disabled (@Nightly)
> [junit4:junit4]   2> NOTE: test params are: codec=Lucene3x, sim=DefaultSimilarity, locale=th, timezone=Africa/Cairo
> [junit4:junit4]   2> NOTE: Linux 3.2.0-34-generic i386/Sun Microsystems Inc. 1.6.0_37 (32-bit)/cpus=8,threads=1,free=66395880,total=94502912
> [junit4:junit4]   2> NOTE: All tests run in this JVM: [TestDateFilter, TestIndexWriterWithThreads, TestScoreCachingWrappingScorer, TestSloppyPhraseQuery, TestRollingUpdates, TestMergeSchedulerExternal, TestParallelTermEnum, Test2BPostingsBytes, TestMultiThreadTermVectors, TestTieredMergePolicy, MultiCollectorTest, TestLevenshteinAutomata, Test4GBStoredFields, TestCompressingStoredFieldsFormat]
> [junit4:junit4] Completed on J0 in 8.41s, 6 tests, 1 failure, 1 skipped <<< FAILURES!
>
> [...truncated 969 lines...]
> BUILD FAILED
> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:352: The following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build.xml:50: The following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1175: The following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:839: There were test failures: 328 suites, 1894 tests, 1 failure, 27 ignored (15 assumptions)
>
> Total time: 6 minutes 25 seconds
> Build step 'Invoke Ant' marked build as failure
> Archiving artifacts
> Recording test results
> Description set: Java: 32bit/jdk1.6.0_37 -server -XX:+UseParallelGC
> Email was triggered for: Failure
> Sending email for trigger: Failure
>
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[JENKINS] Lucene-Solr-4.x-Linux (32bit/jdk1.6.0_37) - Build # 3189 - Still Failing!

Posted by Policeman Jenkins Server <je...@sd-datasolutions.de>.
Build: http://jenkins.sd-datasolutions.de/job/Lucene-Solr-4.x-Linux/3189/
Java: 32bit/jdk1.6.0_37 -server -XX:+UseParallelGC

1 tests failed.
REGRESSION:  org.apache.lucene.codecs.compressing.TestCompressingStoredFieldsFormat.testDeletePartiallyWrittenFilesIfAbort

Error Message:
expected:<2> but was:<0>

Stack Trace:
java.lang.AssertionError: expected:<2> but was:<0>
	at __randomizedtesting.SeedInfo.seed([3CD76ABF62B468ED:63F777E803714901]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.junit.Assert.assertEquals(Assert.java:456)
	at org.apache.lucene.codecs.compressing.TestCompressingStoredFieldsFormat.testDeletePartiallyWrittenFilesIfAbort(TestCompressingStoredFieldsFormat.java:398)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:841)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:662)




Build Log:
[...truncated 300 lines...]
[junit4:junit4] Suite: org.apache.lucene.codecs.compressing.TestCompressingStoredFieldsFormat
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestCompressingStoredFieldsFormat -Dtests.method=testDeletePartiallyWrittenFilesIfAbort -Dtests.seed=3CD76ABF62B468ED -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=th -Dtests.timezone=Africa/Cairo -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] FAILURE 0.03s J0 | TestCompressingStoredFieldsFormat.testDeletePartiallyWrittenFilesIfAbort <<<
[junit4:junit4]    > Throwable #1: java.lang.AssertionError: expected:<2> but was:<0>
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([3CD76ABF62B468ED:63F777E803714901]:0)
[junit4:junit4]    > 	at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4]    > 	at org.junit.Assert.failNotEquals(Assert.java:647)
[junit4:junit4]    > 	at org.junit.Assert.assertEquals(Assert.java:128)
[junit4:junit4]    > 	at org.junit.Assert.assertEquals(Assert.java:472)
[junit4:junit4]    > 	at org.junit.Assert.assertEquals(Assert.java:456)
[junit4:junit4]    > 	at org.apache.lucene.codecs.compressing.TestCompressingStoredFieldsFormat.testDeletePartiallyWrittenFilesIfAbort(TestCompressingStoredFieldsFormat.java:398)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
[junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:597)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:841)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:662)
[junit4:junit4] IGNOR/A 0.00s J0 | TestCompressingStoredFieldsFormat.testBigDocuments
[junit4:junit4]    > Assumption #1: 'nightly' test group is disabled (@Nightly)
[junit4:junit4]   2> NOTE: test params are: codec=Lucene3x, sim=DefaultSimilarity, locale=th, timezone=Africa/Cairo
[junit4:junit4]   2> NOTE: Linux 3.2.0-34-generic i386/Sun Microsystems Inc. 1.6.0_37 (32-bit)/cpus=8,threads=1,free=66395880,total=94502912
[junit4:junit4]   2> NOTE: All tests run in this JVM: [TestDateFilter, TestIndexWriterWithThreads, TestScoreCachingWrappingScorer, TestSloppyPhraseQuery, TestRollingUpdates, TestMergeSchedulerExternal, TestParallelTermEnum, Test2BPostingsBytes, TestMultiThreadTermVectors, TestTieredMergePolicy, MultiCollectorTest, TestLevenshteinAutomata, Test4GBStoredFields, TestCompressingStoredFieldsFormat]
[junit4:junit4] Completed on J0 in 8.41s, 6 tests, 1 failure, 1 skipped <<< FAILURES!

[...truncated 969 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:352: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build.xml:50: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1175: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:839: There were test failures: 328 suites, 1894 tests, 1 failure, 27 ignored (15 assumptions)

Total time: 6 minutes 25 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 32bit/jdk1.6.0_37 -server -XX:+UseParallelGC
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-4.x-Linux (32bit/jdk1.6.0_37) - Build # 3188 - Still Failing!

Posted by Policeman Jenkins Server <je...@sd-datasolutions.de>.
Build: http://jenkins.sd-datasolutions.de/job/Lucene-Solr-4.x-Linux/3188/
Java: 32bit/jdk1.6.0_37 -server -XX:+UseConcMarkSweepGC

3 tests failed.
FAILED:  org.apache.solr.cloud.SyncSliceTest.testDistribSearch

Error Message:
There are still nodes recoverying - waited for 540 seconds

Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 540 seconds
	at __randomizedtesting.SeedInfo.seed([83285C653CB7B51E:2CED27D4BE8D522]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:165)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:115)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:110)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:563)
	at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:224)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:662)


FAILED:  org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch

Error Message:
There are still nodes recoverying - waited for 540 seconds

Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 540 seconds
	at __randomizedtesting.SeedInfo.seed([83285C653CB7B51E:2CED27D4BE8D522]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:165)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:115)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:110)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:563)
	at org.apache.solr.cloud.BasicDistributedZk2Test.brindDownShardIndexSomeDocsAndRecover(BasicDistributedZk2Test.java:321)
	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:83)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:662)


FAILED:  org.apache.solr.cloud.BasicDistributedZkTest.testDistribSearch

Error Message:
Server at http://127.0.0.1:39249/solr returned non ok status:500, message:Server Error

Stack Trace:
org.apache.solr.common.SolrException: Server at http://127.0.0.1:39249/solr returned non ok status:500, message:Server Error
	at __randomizedtesting.SeedInfo.seed([83285C653CB7B51E:2CED27D4BE8D522]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:372)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
	at org.apache.solr.client.solrj.request.CoreAdminRequest.process(CoreAdminRequest.java:429)
	at org.apache.solr.client.solrj.request.CoreAdminRequest.getStatus(CoreAdminRequest.java:472)
	at org.apache.solr.cloud.BasicDistributedZkTest.collectStartTimes(BasicDistributedZkTest.java:959)
	at org.apache.solr.cloud.BasicDistributedZkTest.testCollectionsAPI(BasicDistributedZkTest.java:795)
	at org.apache.solr.cloud.BasicDistributedZkTest.doTest(BasicDistributedZkTest.java:343)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:662)




Build Log:
[...truncated 8091 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZkTest
[junit4:junit4]   2> 3 T658 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZkTest-1355340170678
[junit4:junit4]   2> 4 T658 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 5 T659 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 5 T659 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 6 T659 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4]   2> 6 T659 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4]   2> 6 T659 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 6 T659 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355340170678/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4]   2> 105 T658 oasc.ZkTestServer.run start zk server on port:34554
[junit4:junit4]   2> 106 T658 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:34554 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1a20db3
[junit4:junit4]   2> 106 T664 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:34554. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 106 T658 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 107 T664 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:34554, initiating session
[junit4:junit4]   2> 107 T660 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:38773
[junit4:junit4]   2> 108 T660 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:38773
[junit4:junit4]   2> 108 T662 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 119 T662 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b9091c5b90000 with negotiated timeout 10000 for client /127.0.0.1:38773
[junit4:junit4]   2> 120 T664 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:34554, sessionid = 0x13b9091c5b90000, negotiated timeout = 10000
[junit4:junit4]   2> 120 T665 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1a20db3 name:ZooKeeperConnection Watcher:127.0.0.1:34554 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 120 T658 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 121 T658 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 123 T663 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b9091c5b90000
[junit4:junit4]   2> 124 T665 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 124 T660 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:38773 which had sessionid 0x13b9091c5b90000
[junit4:junit4]   2> 124 T658 oaz.ZooKeeper.close Session: 0x13b9091c5b90000 closed
[junit4:junit4]   2> 125 T658 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:34554/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@199245
[junit4:junit4]   2> 125 T666 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:34554. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 125 T658 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 126 T666 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:34554, initiating session
[junit4:junit4]   2> 126 T660 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:38774
[junit4:junit4]   2> 126 T660 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:38774
[junit4:junit4]   2> 127 T662 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b9091c5b90001 with negotiated timeout 10000 for client /127.0.0.1:38774
[junit4:junit4]   2> 127 T666 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:34554, sessionid = 0x13b9091c5b90001, negotiated timeout = 10000
[junit4:junit4]   2> 127 T667 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@199245 name:ZooKeeperConnection Watcher:127.0.0.1:34554/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 127 T658 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 127 T658 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 130 T658 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 131 T658 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 133 T658 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 135 T658 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 135 T658 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 139 T658 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 140 T658 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 142 T658 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 143 T658 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 145 T658 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 145 T658 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 147 T658 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 148 T658 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 150 T658 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 151 T658 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 154 T658 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 154 T658 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 157 T658 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 157 T658 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 159 T658 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 160 T658 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 162 T658 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 162 T658 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 164 T663 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b9091c5b90001
[junit4:junit4]   2> 165 T667 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 165 T660 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:38774 which had sessionid 0x13b9091c5b90001
[junit4:junit4]   2> 165 T658 oaz.ZooKeeper.close Session: 0x13b9091c5b90001 closed
[junit4:junit4]   2> 220 T658 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 223 T658 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:39923
[junit4:junit4]   2> 224 T658 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 224 T658 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355340170840
[junit4:junit4]   2> 224 T658 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355340170840/'
[junit4:junit4]   2> 249 T658 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 250 T658 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 251 T658 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355340170840
[junit4:junit4]   2> 251 T658 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355340170840/solr.xml
[junit4:junit4]   2> 251 T658 oasc.CoreContainer.<init> New CoreContainer 17770767
[junit4:junit4]   2> 252 T658 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355340170840/'
[junit4:junit4]   2> 252 T658 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355340170840/'
[junit4:junit4]   2> 265 T658 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 275 T658 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:34554/solr
[junit4:junit4]   2> 275 T658 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 276 T658 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:34554 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1dff58b
[junit4:junit4]   2> 277 T677 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:34554. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 277 T658 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 277 T677 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:34554, initiating session
[junit4:junit4]   2> 277 T660 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:38775
[junit4:junit4]   2> 278 T660 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:38775
[junit4:junit4]   2> 279 T662 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b9091c5b90002 with negotiated timeout 20000 for client /127.0.0.1:38775
[junit4:junit4]   2> 279 T677 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:34554, sessionid = 0x13b9091c5b90002, negotiated timeout = 20000
[junit4:junit4]   2> 279 T678 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1dff58b name:ZooKeeperConnection Watcher:127.0.0.1:34554 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 279 T658 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 281 T663 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b9091c5b90002
[junit4:junit4]   2> 281 T660 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:38775 which had sessionid 0x13b9091c5b90002
[junit4:junit4]   2> 281 T658 oaz.ZooKeeper.close Session: 0x13b9091c5b90002 closed
[junit4:junit4]   2> 281 T678 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 282 T658 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:34554/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@136679a
[junit4:junit4]   2> 283 T679 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:34554. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 283 T658 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 290 T679 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:34554, initiating session
[junit4:junit4]   2> 290 T660 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:38776
[junit4:junit4]   2> 290 T660 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:38776
[junit4:junit4]   2> 291 T662 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b9091c5b90003 with negotiated timeout 8000 for client /127.0.0.1:38776
[junit4:junit4]   2> 291 T679 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:34554, sessionid = 0x13b9091c5b90003, negotiated timeout = 8000
[junit4:junit4]   2> 291 T680 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@136679a name:ZooKeeperConnection Watcher:127.0.0.1:34554/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 291 T658 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 293 T663 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b9091c5b90003 type:create cxid:0x2 zxid:0x1b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 295 T658 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 296 T658 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39923_solr
[junit4:junit4]   2> 297 T663 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b9091c5b90003 type:delete cxid:0x7 zxid:0x1d txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:39923_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:39923_solr
[junit4:junit4]   2> 297 T658 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:39923_solr
[junit4:junit4]   2> 299 T658 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 300 T658 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 300 T658 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 300 T658 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 301 T658 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 301 T658 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 302 T658 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 302 T658 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 303 T658 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 303 T658 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 307 T658 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 310 T663 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b9091c5b90003 type:delete cxid:0x15 zxid:0x22 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 310 T658 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 312 T658 oasc.Overseer.start Overseer (id=88823573425750019-127.0.0.1:39923_solr-n_0000000000) starting
[junit4:junit4]   2> 313 T663 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b9091c5b90003 type:create cxid:0x1a zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 313 T663 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b9091c5b90003 type:create cxid:0x1b zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 314 T663 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b9091c5b90003 type:create cxid:0x1c zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 315 T663 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b9091c5b90003 type:create cxid:0x1d zxid:0x27 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 315 T682 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
[junit4:junit4]   2> 316 T658 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 318 T658 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 319 T681 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 331 T683 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355340170840/collection1
[junit4:junit4]   2> 332 T683 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4]   2> 332 T683 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 333 T683 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4]   2> 334 T683 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355340170840/collection1/'
[junit4:junit4]   2> 334 T683 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355340170840/collection1/lib/README' to classloader
[junit4:junit4]   2> 335 T683 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355340170840/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 369 T683 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 422 T683 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 423 T683 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 427 T683 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 928 T683 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 937 T683 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 939 T683 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 951 T683 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 954 T683 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 957 T683 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 958 T683 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 959 T683 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355340170840/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355340170678/control/data/
[junit4:junit4]   2> 959 T683 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@92668c
[junit4:junit4]   2> 966 T683 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355340170678/control/data/index/
[junit4:junit4]   2> 966 T683 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355340170678/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 967 T683 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355340170678/control/data/index forceNew:false
[junit4:junit4]   2> 969 T683 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355340170678/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@109dc38),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 970 T683 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 970 T683 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 975 T683 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 975 T683 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 976 T683 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 976 T683 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 977 T683 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 977 T683 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 977 T683 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 978 T683 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 979 T683 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 980 T683 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 981 T683 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 981 T683 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 982 T683 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 983 T683 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 983 T683 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 984 T683 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 984 T683 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 985 T683 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 986 T683 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 987 T683 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 988 T683 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 988 T683 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 989 T683 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 990 T683 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 991 T683 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 994 T683 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 996 T683 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 997 T683 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 1000 T683 oass.SolrIndexSearcher.<init> Opening Searcher@1fd5492 main
[junit4:junit4]   2> 1000 T683 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 1001 T683 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 1002 T683 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 1002 T683 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 1006 T683 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 1035 T684 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1fd5492 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 1042 T683 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 1042 T683 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 1043 T663 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b9091c5b90003 type:create cxid:0x53 zxid:0x2a txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 1045 T683 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 1045 T683 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:39923/solr shardId:control_shard
[junit4:junit4]   2> 1045 T683 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/control_shard/election
[junit4:junit4]   2> 1050 T663 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b9091c5b90003 type:delete cxid:0x62 zxid:0x31 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4]   2> 1050 T683 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 1051 T663 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b9091c5b90003 type:create cxid:0x63 zxid:0x32 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1332 T681 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 1333 T681 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":"control_shard",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:39923_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:39923/solr"}
[junit4:junit4]   2> 1333 T663 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b9091c5b90003 type:create cxid:0x6a zxid:0x34 txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 1341 T680 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 1552 T683 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 1553 T683 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 1553 T683 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:39923/solr/collection1/
[junit4:junit4]   2> 1553 T683 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 1554 T683 oasc.SyncStrategy.syncToMe http://127.0.0.1:39923/solr/collection1/ has no replicas
[junit4:junit4]   2> 1554 T683 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:39923/solr/collection1/
[junit4:junit4]   2> 1554 T683 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/control_shard
[junit4:junit4]   2> 1557 T663 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b9091c5b90003 type:create cxid:0x89 zxid:0x3f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1846 T681 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 1850 T680 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 1859 T683 oasc.ZkController.register We are http://127.0.0.1:39923/solr/collection1/ and leader is http://127.0.0.1:39923/solr/collection1/
[junit4:junit4]   2> 1859 T683 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:39923/solr
[junit4:junit4]   2> 1859 T683 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 1860 T683 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 1860 T683 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 1861 T683 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 1862 T658 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 1863 T658 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 1863 T658 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 1920 T658 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 1922 T658 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:54668
[junit4:junit4]   2> 1923 T658 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 1923 T658 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355340172540
[junit4:junit4]   2> 1923 T658 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355340172540/'
[junit4:junit4]   2> 1943 T658 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 1943 T658 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 1944 T658 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355340172540
[junit4:junit4]   2> 1944 T658 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355340172540/solr.xml
[junit4:junit4]   2> 1944 T658 oasc.CoreContainer.<init> New CoreContainer 9613738
[junit4:junit4]   2> 1945 T658 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355340172540/'
[junit4:junit4]   2> 1945 T658 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355340172540/'
[junit4:junit4]   2> 1957 T658 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 1966 T658 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:34554/solr
[junit4:junit4]   2> 1967 T658 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 1967 T658 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:34554 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1d9005d
[junit4:junit4]   2> 1968 T694 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:34554. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 1968 T658 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 1969 T694 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:34554, initiating session
[junit4:junit4]   2> 1969 T660 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:38777
[junit4:junit4]   2> 1969 T660 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:38777
[junit4:junit4]   2> 1970 T662 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b9091c5b90004 with negotiated timeout 20000 for client /127.0.0.1:38777
[junit4:junit4]   2> 1970 T694 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:34554, sessionid = 0x13b9091c5b90004, negotiated timeout = 20000
[junit4:junit4]   2> 1970 T695 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1d9005d name:ZooKeeperConnection Watcher:127.0.0.1:34554 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 1970 T658 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 1972 T663 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b9091c5b90004
[junit4:junit4]   2> 1972 T695 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 1972 T660 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:38777 which had sessionid 0x13b9091c5b90004
[junit4:junit4]   2> 1972 T658 oaz.ZooKeeper.close Session: 0x13b9091c5b90004 closed
[junit4:junit4]   2> 1973 T658 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:34554/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@1d86178
[junit4:junit4]   2> 1974 T696 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:34554. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 1973 T658 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 1974 T696 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:34554, initiating session
[junit4:junit4]   2> 1974 T660 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:38778
[junit4:junit4]   2> 1974 T660 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:38778
[junit4:junit4]   2> 1975 T662 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b9091c5b90005 with negotiated timeout 8000 for client /127.0.0.1:38778
[junit4:junit4]   2> 1975 T696 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:34554, sessionid = 0x13b9091c5b90005, negotiated timeout = 8000
[junit4:junit4]   2> 1975 T697 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1d86178 name:ZooKeeperConnection Watcher:127.0.0.1:34554/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 1975 T658 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 1976 T663 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b9091c5b90005 type:create cxid:0x1 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1977 T663 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b9091c5b90005 type:create cxid:0x2 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1977 T658 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54668_solr
[junit4:junit4]   2> 1978 T663 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b9091c5b90005 type:delete cxid:0x4 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:54668_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:54668_solr
[junit4:junit4]   2> 1982 T658 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:54668_solr
[junit4:junit4]   2> 1984 T680 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 1984 T680 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 1985 T658 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 1985 T658 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 1986 T658 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 1986 T658 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 1987 T658 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 1987 T658 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 1987 T658 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 1988 T658 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 1988 T658 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 1989 T658 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 1994 T658 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 1998 T698 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355340172540/collection1
[junit4:junit4]   2> 1999 T698 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 1999 T698 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 1999 T698 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 2000 T698 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355340172540/collection1/'
[junit4:junit4]   2> 2001 T698 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty1-1355340172540/collection1/lib/README' to classloader
[junit4:junit4]   2> 2001 T698 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty1-1355340172540/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 2035 T698 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 2084 T698 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 2085 T698 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 2089 T698 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 2354 T681 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2354 T681 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":"control_shard",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:39923_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:39923/solr"}
[junit4:junit4]   2> 2358 T697 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 2358 T680 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 2522 T698 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 2528 T698 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 2531 T698 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 2541 T698 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 2544 T698 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 2551 T698 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 2552 T698 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 2553 T698 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355340172540/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355340170678/jetty1/
[junit4:junit4]   2> 2553 T698 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@92668c
[junit4:junit4]   2> 2554 T698 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355340170678/jetty1/index/
[junit4:junit4]   2> 2554 T698 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355340170678/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 2555 T698 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355340170678/jetty1/index forceNew:false
[junit4:junit4]   2> 2561 T698 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355340170678/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@c39e22),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 2561 T698 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 2561 T698 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 2563 T698 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 2563 T698 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 2563 T698 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 2563 T698 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 2564 T698 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 2564 T698 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 2564 T698 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 2565 T698 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 2566 T698 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 2566 T698 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 2567 T698 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 2567 T698 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 2568 T698 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 2568 T698 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 2568 T698 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 2569 T698 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 2570 T698 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2570 T698 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2571 T698 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2572 T698 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2572 T698 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2573 T698 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2573 T698 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2574 T698 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 2575 T698 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 2577 T698 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 2578 T698 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 2579 T698 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 2581 T698 oass.SolrIndexSearcher.<init> Opening Searcher@1c359a0 main
[junit4:junit4]   2> 2582 T698 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 2582 T698 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 2582 T698 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 2583 T698 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 2587 T698 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 2610 T699 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1c359a0 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 2615 T698 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 2615 T698 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 2862 T681 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2862 T681 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:54668_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:54668/solr"}
[junit4:junit4]   2> 2863 T681 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4]   2> 2866 T681 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 2870 T697 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 2870 T680 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3116 T698 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 3117 T698 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:54668/solr shardId:shard1
[junit4:junit4]   2> 3117 T698 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 3122 T663 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b9091c5b90005 type:delete cxid:0x45 zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 3123 T698 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 3123 T663 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b9091c5b90005 type:create cxid:0x46 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3125 T698 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 3125 T698 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 3125 T698 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:54668/solr/collection1/
[junit4:junit4]   2> 3126 T698 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 3126 T698 oasc.SyncStrategy.syncToMe http://127.0.0.1:54668/solr/collection1/ has no replicas
[junit4:junit4]   2> 3127 T698 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:54668/solr/collection1/
[junit4:junit4]   2> 3127 T698 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 3131 T663 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b9091c5b90005 type:create cxid:0x50 zxid:0x60 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3374 T681 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3381 T697 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3381 T680 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3382 T698 oasc.ZkController.register We are http://127.0.0.1:54668/solr/collection1/ and leader is http://127.0.0.1:54668/solr/collection1/
[junit4:junit4]   2> 3383 T698 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:54668/solr
[junit4:junit4]   2> 3383 T698 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 3383 T698 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 3383 T698 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 3385 T698 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3385 T658 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 3386 T658 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 3387 T658 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 3456 T658 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 3458 T658 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:37474
[junit4:junit4]   2> 3458 T658 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 3459 T658 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355340174064
[junit4:junit4]   2> 3459 T658 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355340174064/'
[junit4:junit4]   2> 3472 T658 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 3473 T658 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 3473 T658 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355340174064
[junit4:junit4]   2> 3474 T658 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355340174064/solr.xml
[junit4:junit4]   2> 3474 T658 oasc.CoreContainer.<init> New CoreContainer 11497471
[junit4:junit4]   2> 3474 T658 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355340174064/'
[junit4:junit4]   2> 3475 T658 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355340174064/'
[junit4:junit4]   2> 3488 T658 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 3503 T658 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:34554/solr
[junit4:junit4]   2> 3504 T658 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 3504 T658 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:34554 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@651a76
[junit4:junit4]   2> 3505 T709 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:34554. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 3505 T658 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3506 T709 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:34554, initiating session
[junit4:junit4]   2> 3506 T660 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:38780
[junit4:junit4]   2> 3506 T660 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:38780
[junit4:junit4]   2> 3507 T662 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b9091c5b90006 with negotiated timeout 20000 for client /127.0.0.1:38780
[junit4:junit4]   2> 3507 T709 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:34554, sessionid = 0x13b9091c5b90006, negotiated timeout = 20000
[junit4:junit4]   2> 3507 T710 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@651a76 name:ZooKeeperConnection Watcher:127.0.0.1:34554 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3508 T658 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3509 T663 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b9091c5b90006
[junit4:junit4]   2> 3510 T710 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 3510 T660 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:38780 which had sessionid 0x13b9091c5b90006
[junit4:junit4]   2> 3510 T658 oaz.ZooKeeper.close Session: 0x13b9091c5b90006 closed
[junit4:junit4]   2> 3510 T658 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:34554/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@c1806b
[junit4:junit4]   2> 3512 T711 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:34554. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 3512 T658 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3512 T711 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:34554, initiating session
[junit4:junit4]   2> 3512 T660 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:38781
[junit4:junit4]   2> 3512 T660 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:38781
[junit4:junit4]   2> 3513 T662 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b9091c5b90007 with negotiated timeout 8000 for client /127.0.0.1:38781
[junit4:junit4]   2> 3513 T711 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:34554, sessionid = 0x13b9091c5b90007, negotiated timeout = 8000
[junit4:junit4]   2> 3514 T712 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@c1806b name:ZooKeeperConnection Watcher:127.0.0.1:34554/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3514 T658 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3515 T663 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b9091c5b90007 type:create cxid:0x1 zxid:0x6d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3515 T663 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b9091c5b90007 type:create cxid:0x2 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3516 T658 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37474_solr
[junit4:junit4]   2> 3517 T663 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b9091c5b90007 type:delete cxid:0x4 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:37474_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:37474_solr
[junit4:junit4]   2> 3518 T658 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:37474_solr
[junit4:junit4]   2> 3519 T697 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3520 T680 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 3520 T680 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 3520 T658 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 3521 T697 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 3521 T658 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 3521 T658 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 3522 T658 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 3522 T658 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 3522 T658 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 3523 T658 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 3523 T658 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 3524 T658 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 3524 T658 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 3529 T658 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3535 T713 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355340174064/collection1
[junit4:junit4]   2> 3536 T713 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 3536 T713 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 3536 T713 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 3537 T713 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355340174064/collection1/'
[junit4:junit4]   2> 3538 T713 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty2-1355340174064/collection1/lib/README' to classloader
[junit4:junit4]   2> 3538 T713 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty2-1355340174064/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 3573 T713 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 3623 T713 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 3624 T713 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 3628 T713 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 3887 T681 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3888 T681 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:54668_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:54668/solr"}
[junit4:junit4]   2> 3895 T697 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 3895 T712 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 3895 T680 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4047 T713 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 4052 T713 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 4064 T713 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 4075 T713 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 4078 T713 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 4081 T713 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 4082 T713 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 4083 T713 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355340174064/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355340170678/jetty2/
[junit4:junit4]   2> 4084 T713 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@92668c
[junit4:junit4]   2> 4084 T713 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355340170678/jetty2/index/
[junit4:junit4]   2> 4085 T713 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355340170678/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 4085 T713 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355340170678/jetty2/index forceNew:false
[junit4:junit4]   2> 4088 T713 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355340170678/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@b7b77d),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 4088 T713 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 4089 T713 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 4090 T713 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 4090 T713 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 4090 T713 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 4091 T713 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 4091 T713 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 4091 T713 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 4091 T713 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 4092 T713 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 4093 T713 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 4094 T713 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 4094 T713 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 4094 T713 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 4095 T713 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 4095 T713 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 4096 T713 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 4096 T713 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 4097 T713 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4098 T713 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4098 T713 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4099 T713 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4099 T713 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4100 T713 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4101 T713 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4101 T713 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 4102 T713 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 4104 T713 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 4105 T713 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 4107 T713 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 4108 T713 oass.SolrIndexSearcher.<init> Opening Searcher@d68d1a main
[junit4:junit4]   2> 4109 T713 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 4109 T713 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 4109 T713 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 4110 T713 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 4113 T713 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 4139 T714 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@d68d1a main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 4143 T713 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 4144 T713 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 4399 T681 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4400 T681 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:37474_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:37474/solr"}
[junit4:junit4]   2> 4400 T681 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 4400 T681 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4]   2> 4404 T697 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4404 T680 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4404 T712 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4645 T713 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 4645 T713 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:37474/solr shardId:shard2
[junit4:junit4]   2> 4646 T713 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4]   2> 4651 T663 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b9091c5b90007 type:delete cxid:0x44 zxid:0x7e txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard2 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard2
[junit4:junit4]   2> 4652 T713 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 4652 T663 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b9091c5b90007 type:create cxid:0x45 zxid:0x7f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4654 T713 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 4654 T713 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 4654 T713 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:37474/solr/collection1/
[junit4:junit4]   2> 4654 T713 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 4655 T713 oasc.SyncStrategy.syncToMe http://127.0.0.1:37474/solr/collection1/ has no replicas
[junit4:junit4]   2> 4655 T713 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:37474/solr/collection1/
[junit4:junit4]   2> 4655 T713 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4]   2> 4657 T663 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b9091c5b90007 type:create cxid:0x4e zxid:0x82 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4907 T681 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4913 T712 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4913 T697 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4914 T680 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4959 T713 oasc.ZkController.register We are http://127.0.0.1:37474/solr/collection1/ and leader is http://127.0.0.1:37474/solr/collection1/
[junit4:junit4]   2> 4960 T713 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:37474/solr
[junit4:junit4]   2> 4960 T713 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 4960 T713 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 4960 T713 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 4963 T713 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4963 T658 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 4964 T658 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 4964 T658 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 5021 T658 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 5023 T658 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:39249
[junit4:junit4]   2> 5024 T658 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 5025 T658 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355340175641
[junit4:junit4]   2> 5025 T658 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355340175641/'
[junit4:junit4]   2> 5037 T658 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 5038 T658 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 5038 T658 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355340175641
[junit4:junit4]   2> 5038 T658 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355340175641/solr.xml
[junit4:junit4]   2> 5039 T658 oasc.CoreContainer.<init> New CoreContainer 28026538
[junit4:junit4]   2> 5039 T658 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355340175641/'
[junit4:junit4]   2> 5040 T658 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355340175641/'
[junit4:junit4]   2> 5052 T658 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 5065 T658 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:34554/solr
[junit4:junit4]   2> 5066 T658 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 5067 T658 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:34554 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@b2a51f
[junit4:junit4]   2> 5068 T724 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:34554. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 5067 T658 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 5068 T724 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:34554, initiating session
[junit4:junit4]   2> 5068 T660 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:38783
[junit4:junit4]   2> 5069 T660 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:38783
[junit4:junit4]   2> 5069 T662 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b9091c5b90008 with negotiated timeout 20000 for client /127.0.0.1:38783
[junit4:junit4]   2> 5069 T724 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:34554, sessionid = 0x13b9091c5b90008, negotiated timeout = 20000
[junit4:junit4]   2> 5070 T725 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b2a51f name:ZooKeeperConnection Watcher:127.0.0.1:34554 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 5070 T658 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 5071 T663 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b9091c5b90008
[junit4:junit4]   2> 5072 T660 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:38783 which had sessionid 0x13b9091c5b90008
[junit4:junit4]   2> 5072 T725 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 5072 T658 oaz.ZooKeeper.close Session: 0x13b9091c5b90008 closed
[junit4:junit4]   2> 5072 T658 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:34554/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@15d6964
[junit4:junit4]   2> 5074 T726 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:34554. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 5073 T658 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 5074 T660 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:38784
[junit4:junit4]   2> 5074 T726 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:34554, initiating session
[junit4:junit4]   2> 5074 T660 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:38784
[junit4:junit4]   2> 5075 T662 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b9091c5b90009 with negotiated timeout 8000 for client /127.0.0.1:38784
[junit4:junit4]   2> 5075 T726 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:34554, sessionid = 0x13b9091c5b90009, negotiated timeout = 8000
[junit4:junit4]   2> 5075 T727 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@15d6964 name:ZooKeeperConnection Watcher:127.0.0.1:34554/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 5075 T658 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 5076 T663 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b9091c5b90009 type:create cxid:0x1 zxid:0x8f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5077 T663 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b9091c5b90009 type:create cxid:0x2 zxid:0x90 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5078 T658 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39249_solr
[junit4:junit4]   2> 5078 T663 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b9091c5b90009 type:delete cxid:0x4 zxid:0x91 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:39249_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:39249_solr
[junit4:junit4]   2> 5079 T658 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:39249_solr
[junit4:junit4]   2> 5081 T697 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5081 T680 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 5081 T712 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 5082 T680 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5082 T712 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5082 T697 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 5083 T658 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 5084 T658 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 5084 T658 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 5085 T658 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 5085 T658 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 5085 T658 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 5086 T658 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 5086 T658 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 5087 T658 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 5087 T658 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 5092 T658 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 5097 T728 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355340175641/collection1
[junit4:junit4]   2> 5098 T728 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 5098 T728 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 5098 T728 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 5099 T728 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355340175641/collection1/'
[junit4:junit4]   2> 5100 T728 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty3-1355340175641/collection1/lib/README' to classloader
[junit4:junit4]   2> 5100 T728 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty3-1355340175641/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 5146 T728 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 5203 T728 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 5204 T728 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 5208 T728 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 5419 T681 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5419 T681 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:37474_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:37474/solr"}
[junit4:junit4]   2> 5423 T697 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5423 T712 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5423 T727 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5423 T680 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5641 T728 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 5646 T728 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 5649 T728 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 5660 T728 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5663 T728 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5665 T728 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5666 T728 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5667 T728 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355340175641/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355340170678/jetty3/
[junit4:junit4]   2> 5668 T728 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@92668c
[junit4:junit4]   2> 5668 T728 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355340170678/jetty3/index/
[junit4:junit4]   2> 5668 T728 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355340170678/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 5669 T728 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355340170678/jetty3/index forceNew:false
[junit4:junit4]   2> 5702 T728 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355340170678/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1dd3a24),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 5702 T728 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 5703 T728 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 5704 T728 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 5704 T728 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 5704 T728 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 5705 T728 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 5705 T728 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 5705 T728 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 5706 T728 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 5706 T728 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 5707 T728 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 5708 T728 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 5709 T728 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 5709 T728 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 5710 T728 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 5710 T728 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 5711 T728 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 5711 T728 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 5712 T728 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5713 T728 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5714 T728 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5714 T728 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5715 T728 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5716 T728 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5716 T728 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5717 T728 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 5717 T728 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 5719 T728 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 5721 T728 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 5723 T728 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 5724 T728 oass.SolrIndexSearcher.<init> Opening Searcher@66577 main
[junit4:junit4]   2> 5725 T728 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 5725 T728 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 5725 T728 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 5726 T728 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 5730 T728 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 5757 T729 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@66577 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 5762 T728 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 5762 T728 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 5928 T681 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5929 T681 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:39249_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:39249/solr"}
[junit4:junit4]   2> 5929 T681 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 5930 T681 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 5935 T697 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5935 T712 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5935 T727 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5935 T680 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6264 T728 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 6264 T728 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:39249/solr shardId:shard1
[junit4:junit4]   2> 6270 T728 oasc.ZkController.register We are http://127.0.0.1:39249/solr/collection1/ and leader is http://127.0.0.1:54668/solr/collection1/
[junit4:junit4]   2> 6270 T728 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:39249/solr
[junit4:junit4]   2> 6270 T728 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 6271 T728 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C96 name=collection1 org.apache.solr.core.SolrCore@19dbd6a url=http://127.0.0.1:39249/solr/collection1 node=127.0.0.1:39249_solr
[junit4:junit4]   2> 6277 T730 C96 P39249 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 6278 T728 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6278 T730 C96 P39249 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 6279 T730 C96 P39249 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 6279 T730 C96 P39249 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 6280 T658 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 6281 T730 C96 P39249 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:54668/solr/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 6281 T658 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 6282 T658 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 6287 T730 C96 P39249 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4]   2> 6294 T730 C96 P39249 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:39249/solr START replicas=[http://127.0.0.1:54668/solr/collection1/] nUpdates=100
[junit4:junit4]   2> 6296 T730 C96 P39249 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 6296 T730 C96 P39249 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 6296 T730 C96 P39249 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 6296 T730 C96 P39249 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C97 name=collection1 org.apache.solr.core.SolrCore@17badfa url=http://127.0.0.1:54668/solr/collection1 node=127.0.0.1:54668_solr
[junit4:junit4]   2> 6308 T691 C97 P54668 REQ /get {distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=0 
[junit4:junit4]   2> 6349 T658 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 6351 T658 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:51298
[junit4:junit4]   2> 6352 T658 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 6352 T658 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355340176962
[junit4:junit4]   2> 6352 T658 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355340176962/'
[junit4:junit4]   2> 6369 T658 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 6369 T658 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 6370 T658 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355340176962
[junit4:junit4]   2> 6370 T658 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355340176962/solr.xml
[junit4:junit4]   2> 6371 T658 oasc.CoreContainer.<init> New CoreContainer 14758647
[junit4:junit4]   2> 6371 T658 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355340176962/'
[junit4:junit4]   2> 6371 T658 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355340176962/'
[junit4:junit4]   2> 6383 T658 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 6393 T658 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:34554/solr
[junit4:junit4]   2> 6393 T658 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 6394 T658 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:34554 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@4c545b
[junit4:junit4]   2> 6395 T658 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6395 T741 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:34554. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 6396 T741 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:34554, initiating session
[junit4:junit4]   2> 6396 T660 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:38787
[junit4:junit4]   2> 6396 T660 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:38787
[junit4:junit4]   2> 6397 T662 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b9091c5b9000a with negotiated timeout 20000 for client /127.0.0.1:38787
[junit4:junit4]   2> 6397 T741 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:34554, sessionid = 0x13b9091c5b9000a, negotiated timeout = 20000
[junit4:junit4]   2> 6397 T742 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4c545b name:ZooKeeperConnection Watcher:127.0.0.1:34554 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6397 T658 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6398 T663 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b9091c5b9000a
[junit4:junit4]   2> 6399 T742 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 6399 T660 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:38787 which had sessionid 0x13b9091c5b9000a
[junit4:junit4]   2> 6399 T658 oaz.ZooKeeper.close Session: 0x13b9091c5b9000a closed
[junit4:junit4]   2> 6400 T658 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:34554/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@81e401
[junit4:junit4]   2> 6401 T743 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:34554. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 6401 T658 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6401 T743 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:34554, initiating session
[junit4:junit4]   2> 6401 T660 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:38788
[junit4:junit4]   2> 6401 T660 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:38788
[junit4:junit4]   2> 6402 T662 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b9091c5b9000b with negotiated timeout 8000 for client /127.0.0.1:38788
[junit4:junit4]   2> 6402 T743 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:34554, sessionid = 0x13b9091c5b9000b, negotiated timeout = 8000
[junit4:junit4]   2> 6402 T744 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@81e401 name:ZooKeeperConnection Watcher:127.0.0.1:34554/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6403 T658 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6403 T663 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b9091c5b9000b type:create cxid:0x1 zxid:0xa2 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6404 T663 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b9091c5b9000b type:create cxid:0x2 zxid:0xa3 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6405 T658 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51298_solr
[junit4:junit4]   2> 6406 T663 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b9091c5b9000b type:delete cxid:0x4 zxid:0xa4 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:51298_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:51298_solr
[junit4:junit4]   2> 6406 T658 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51298_solr
[junit4:junit4]   2> 6408 T697 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6409 T712 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 6409 T680 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 6409 T712 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6409 T680 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6409 T727 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 6409 T727 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6410 T658 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 6410 T697 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 6411 T658 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 6411 T658 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 6412 T658 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 6412 T658 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 6412 T658 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 6413 T658 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 6413 T658 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 6414 T658 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 6414 T658 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 6419 T658 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 6429 T745 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355340176962/collection1
[junit4:junit4]   2> 6429 T745 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 6430 T745 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 6430 T745 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 6431 T745 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355340176962/collection1/'
[junit4:junit4]   2> 6432 T745 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty4-1355340176962/collection1/lib/README' to classloader
[junit4:junit4]   2> 6432 T745 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty4-1355340176962/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 6439 T681 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6440 T681 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:39249_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:39249/solr"}
[junit4:junit4]   2> 6445 T697 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6445 T727 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6445 T680 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6446 T744 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6446 T712 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6472 T745 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 6528 T745 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 6529 T745 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 6533 T745 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 6997 T745 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 7003 T745 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 7006 T745 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 7018 T745 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 7021 T745 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 7024 T745 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 7025 T745 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 7026 T745 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355340176962/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355340170678/jetty4/
[junit4:junit4]   2> 7026 T745 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@92668c
[junit4:junit4]   2> 7027 T745 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355340170678/jetty4/index/
[junit4:junit4]   2> 7027 T745 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355340170678/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 7027 T745 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355340170678/jetty4/index forceNew:false
[junit4:junit4]   2> 7030 T745 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355340170678/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1131938),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 7030 T745 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 7031 T745 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 7032 T745 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 7032 T745 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 7032 T745 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 7033 T745 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 7033 T745 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 7033 T745 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 7034 T745 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 7034 T745 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 7039 T745 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 7040 T745 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 7041 T745 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 7042 T745 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 7043 T745 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 7043 T745 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 7043 T745 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 7044 T745 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 7045 T745 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7047 T745 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7048 T745 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7048 T745 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7049 T745 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7051 T745 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7052 T745 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7053 T745 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 7054 T745 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 7055 T745 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 7057 T745 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 7059 T745 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 7060 T745 oass.SolrIndexSearcher.<init> Opening Searcher@145fd39 main
[junit4:junit4]   2> 7061 T745 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 7061 T745 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 7061 T745 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 7062 T745 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 7067 T745 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 7101 T746 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@145fd39 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 7105 T745 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 7106 T745 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 7455 T681 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7456 T681 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:51298_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:51298/solr"}
[junit4:junit4]   2> 7456 T681 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 7456 T681 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4]   2> 7461 T697 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7461 T727 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7461 T680 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7461 T712 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7461 T744 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7607 T745 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 7607 T745 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:51298/solr shardId:shard2
[junit4:junit4]   2> 7610 T745 oasc.ZkController.register We are http://127.0.0.1:51298/solr/collection1/ and leader is http://127.0.0.1:37474/solr/collection1/
[junit4:junit4]   2> 7611 T745 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51298/solr
[junit4:junit4]   2> 7611 T745 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 7611 T745 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C98 name=collection1 org.apache.solr.core.SolrCore@1369036 url=http://127.0.0.1:51298/solr/collection1 node=127.0.0.1:51298_solr
[junit4:junit4]   2> 7612 T747 C98 P51298 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 7612 T747 C98 P51298 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 7612 T745 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7613 T747 C98 P51298 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 7613 T747 C98 P51298 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 7614 T747 C98 P51298 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:37474/solr/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 7613 T658 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 7614 T747 C98 P51298 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:51298/solr START replicas=[http://127.0.0.1:37474/solr/collection1/] nUpdates=100
[junit4:junit4]   2> 7614 T747 C98 P51298 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 7614 T658 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 7615 T747 C98 P51298 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 7615 T747 C98 P51298 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 7615 T658 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 7615 T747 C98 P51298 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C99 name=collection1 org.apache.solr.core.SolrCore@e25508 url=http://127.0.0.1:37474/solr/collection1 node=127.0.0.1:37474_solr
[junit4:junit4]   2> 7620 T705 C99 P37474 REQ /get {distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=0 
[junit4:junit4]   2> 7620 T658 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:34554/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@19ab287
[junit4:junit4]   2> 7621 T658 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 7621 T749 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:34554. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 7622 T660 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:38791
[junit4:junit4]   2> 7622 T749 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:34554, initiating session
[junit4:junit4]   2> 7622 T660 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:38791
[junit4:junit4]   2> 7623 T662 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b9091c5b9000c with negotiated timeout 10000 for client /127.0.0.1:38791
[junit4:junit4]   2> 7623 T749 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:34554, sessionid = 0x13b9091c5b9000c, negotiated timeout = 10000
[junit4:junit4]   2> 7623 T750 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@19ab287 name:ZooKeeperConnection Watcher:127.0.0.1:34554/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 7624 T658 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 7624 T658 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 7627 T658 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 7628 T658 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 7631 T658 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7633 T658 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):540
[junit4:junit4]   2> 7633 T658 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7969 T681 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7970 T681 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:51298_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:51298/solr"}
[junit4:junit4]   2> 7984 T697 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7984 T727 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7984 T750 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7984 T712 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7984 T744 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7985 T680 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8635 T658 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2>  C96_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:39249_solr, base_url=http://127.0.0.1:39249/solr}
[junit4:junit4]   2> 9304 T730 C96 P39249 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 9304 T730 C96 P39249 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 9305 T730 C96 P39249 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:54668/solr/collection1/. core=collection1
[junit4:junit4]   2> 9305 T730 C96 P39249 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 9319 T690 C97 P54668 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16
[junit4:junit4]   2> 9325 T690 C97 P54668 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 9331 T690 C97 P54668 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355340170678/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@c39e22),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 9332 T690 C97 P54668 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 9339 T690 C97 P54668 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355340170678/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@c39e22),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355340170678/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@c39e22),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 9339 T690 C97 P54668 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 9340 T690 C97 P54668 oass.SolrIndexSearcher.<init> Opening Searcher@1519600 realtime
[junit4:junit4]   2> 9340 T690 C97 P54668 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 9341 T690 C97 P54668 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 9341 T690 C97 P54668 /update {waitSearcher=true&openSearcher=false&commit=true&commit_end_point=true&wt=javabin&softCommit=false&version=2} {commit=} 0 25
[junit4:junit4]   2> 9342 T730 C96 P39249 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 9343 T730 C96 P39249 oascsi.HttpClientUtil.createClient Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
[junit4:junit4]   2> 9349 T730 C96 P39249 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 9354 T691 C97 P54668 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 9354 T691 C97 P54668 REQ /replication {command=indexversion&wt=javabin&qt=/replication&version=2} status=0 QTime=2 
[junit4:junit4]   2> 9355 T730 C96 P39249 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 9355 T730 C96 P39249 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 9355 T730 C96 P39249 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 9358 T690 C97 P54668 REQ /replication {command=filelist&generation=2&wt=javabin&qt=/replication&version=2} status=0 QTime=1 
[junit4:junit4]   2> 9359 T730 C96 P39249 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 9359 T730 C96 P39249 oash.SnapPuller.fetchLatestIndex Starting download to ./org.apache.solr.cloud.BasicDistributedZkTest-1355340170678/jetty3/index.20121212142300033 fullCopy=true
[junit4:junit4]   2> 9366 T693 C97 P54668 REQ /replication {file=segments_2&command=filecontent&checksum=true&generation=2&qt=/replication&wt=filestream} status=0 QTime=3 
[junit4:junit4]   2> 9370 T730 C96 P39249 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 9379 T730 C96 P39249 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20121212142300033
[junit4:junit4]   2> 9380 T730 C96 P39249 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.BasicDistributedZkTest-1355340170678/jetty3/index/ new=./org.apache.solr.cloud.BasicDistributedZkTest-1355340170678/jetty3/index.20121212142300033
[junit4:junit4]   2> 9380 T730 C96 P39249 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355340170678/jetty3/index.20121212142300033 forceNew:false
[junit4:junit4]   2> 9381 T730 C96 P39249 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355340170678/jetty3/index.20121212142300033 lockFactory=org.apache.lucene.store.NativeFSLockFactory@440f9e),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 9382 T730 C96 P39249 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 9383 T730 C96 P39249 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 9384 T730 C96 P39249 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 9384 T730 C96 P39249 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4]   2> 9384 T730 C96 P39249 oasc.CachingDirectoryFactory.close Closing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355340170678/jetty3/index.20121212142300033
[junit4:junit4]   2> 9385 T730 C96 P39249 oash.SnapPuller$2.onClose removing old index directory ./org.apache.solr.cloud.BasicDistributedZkTest-1355340170678/jetty3/index
[junit4:junit4]   2> 9385 T730 C96 P39249 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355340170678/jetty3/index.20121212142300033 forceNew:true
[junit4:junit4]   2> 9387 T730 C96 P39249 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355340170678/jetty3/index.20121212142300033 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1a60374),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 9387 T730 C96 P39249 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 9387 T730 C96 P39249 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 9388 T730 C96 P39249 oass.SolrIndexSearcher.<init> Opening Searcher@abc1ea main
[junit4:junit4]   2> 9388 T730 C96 P39249 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 9389 T729 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@abc1ea main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 9389 T730 C96 P39249 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 9420 T730 C96 P39249 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355340170678/jetty3/index.20121212142300033 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1a60374),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355340170678/jetty3/index.20121212142300033 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1a60374),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 9421 T730 C96 P39249 oasc.SolrDeletionPolicy.updateCommits newest commit = 3
[junit4:junit4]   2> 9421 T730 C96 P39249 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 9421 T730 C96 P39249 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 9421 T730 C96 P39249 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 9421 T730 C96 P39249 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 9422 T730 C96 P39249 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 9422 T730 C96 P39249 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 9497 T681 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9498 T681 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:39249_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:39249/solr"}
[junit4:junit4]   2> 9509 T750 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9509 T712 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9509 T744 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9509 T680 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9509 T727 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9509 T697 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9638 T658 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2>  C98_STATE=coll:collection1 core:collection1 props:{shard=shard2, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:51298_solr, base_url=http://127.0.0.1:51298/solr}
[junit4:junit4]   2> 10622 T747 C98 P51298 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 10622 T747 C98 P51298 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 10622 T747 C98 P51298 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:37474/solr/collection1/. core=collection1
[junit4:junit4]   2> 10623 T747 C98 P51298 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 10628 T707 C99 P37474 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 10630 T707 C99 P37474 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355340170678/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@b7b77d),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 10630 T707 C99 P37474 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 10639 T707 C99 P37474 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355340170678/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@b7b77d),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355340170678/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@b7b77d),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 10639 T707 C99 P37474 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 10640 T707 C99 P37474 oass.SolrIndexSearcher.<init> Opening Searcher@4ce3ef realtime
[junit4:junit4]   2> 10640 T707 C99 P37474 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 10640 T658 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10641 T707 C99 P37474 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 10641 T707 C99 P37474 /update {waitSearcher=true&openSearcher=false&commit=true&commit_end_point=true&wt=javabin&softCommit=false&version=2} {commit=} 0 13
[junit4:junit4]   2> 10642 T747 C98 P51298 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 10643 T747 C98 P51298 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 10645 T705 C99 P37474 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 10645 T705 C99 P37474 REQ /replication {command=indexversion&wt=javabin&qt=/replication&version=2} status=0 QTime=1 
[junit4:junit4]   2> 10646 T747 C98 P51298 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 10646 T747 C98 P51298 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 10646 T747 C98 P51298 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 10649 T706 C99 P37474 REQ /replication {command=filelist&generation=2&wt=javabin&qt=/replication&version=2} status=0 QTime=1 
[junit4:junit4]   2> 10649 T747 C98 P51298 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 10650 T747 C98 P51298 oash.SnapPuller.fetchLatestIndex Starting download to ./org.apache.solr.cloud.BasicDistributedZkTest-1355340170678/jetty4/index.20121212142301323 fullCopy=true
[junit4:junit4]   2> 10652 T707 C99 P37474 REQ /replication {file=segments_2&command=filecontent&checksum=true&generation=2&qt=/replication&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 10654 T747 C98 P51298 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 10659 T747 C98 P51298 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20121212142301323
[junit4:junit4]   2> 10659 T747 C98 P51298 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.BasicDistributedZkTest-1355340170678/jetty4/index/ new=./org.apache.solr.cloud.BasicDistributedZkTest-1355340170678/jetty4/index.20121212142301323
[junit4:junit4]   2> 10660 T747 C98 P51298 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355340170678/jetty4/index.20121212142301323 forceNew:false
[junit4:junit4]   2> 10661 T747 C98 P51298 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355340170678/jetty4/index.20121212142301323 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1e54e64),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 10661 T747 C98 P51298 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 10662 T747 C98 P51298 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 10662 T747 C98 P51298 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 10662 T747 C98 P51298 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4]   2> 10662 T747 C98 P51298 oasc.CachingDirectoryFactory.close Closing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355340170678/jetty4/index.20121212142301323
[junit4:junit4]   2> 10663 T747 C98 P51298 oash.SnapPuller$2.onClose removing old index directory ./org.apache.solr.cloud.BasicDistributedZkTest-1355340170678/jetty4/index
[junit4:junit4]   2> 10663 T747 C98 P51298 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355340170678/jetty4/index.20121212142301323 forceNew:true
[junit4:junit4]   2> 10664 T747 C98 P51298 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355340170678/jetty4/index.20121212142301323 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1fc38e4),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 10665 T747 C98 P51298 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 10665 T747 C98 P51298 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 10665 T747 C98 P51298 oass.SolrIndexSearcher.<init> Opening Searcher@1b65bb0 main
[junit4:junit4]   2> 10665 T747 C98 P51298 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 10671 T746 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1b65bb0 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 10671 T747 C98 P51298 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 10700 T747 C98 P51298 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355340170678/jetty4/index.20121212142301323 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1fc38e4),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355340170678/jetty4/index.20121212142301323 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1fc38e4),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 10700 T747 C98 P51298 oasc.SolrDeletionPolicy.updateCommits newest commit = 3
[junit4:junit4]   2> 10701 T747 C98 P51298 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 10701 T747 C98 P51298 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 10701 T747 C98 P51298 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 10701 T747 C98 P51298 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 10701 T747 C98 P51298 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 10702 T747 C98 P51298 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 11019 T681 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 11021 T681 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:51298_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:51298/solr"}
[junit4:junit4]   2> 11027 T697 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 11027 T712 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 11027 T750 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 11027 T727 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 11027 T744 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 11027 T680 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 11642 T658 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> ASYNC  NEW_CORE C100 name=collection1 org.apache.solr.core.SolrCore@4e819 url=http://127.0.0.1:39923/solr/collection1 node=127.0.0.1:39923_solr
[junit4:junit4]   2> 11670 T675 C100 P39923 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355340170678/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@109dc38),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 11671 T675 C100 P39923 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 11672 T675 C100 P39923 oass.SolrIndexSearcher.<init> Opening Searcher@1c9570b realtime
[junit4:junit4]   2> 11672 T675 C100 P39923 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 11673 T675 C100 P39923 /update {wt=javabin&version=2} {deleteByQuery=*:* (-1421177187039444992)} 0 10
[junit4:junit4]   2> 11673 T658 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:34554/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1719938
[junit4:junit4]   2> 11674 T753 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:34554. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 11674 T658 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 11675 T753 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:34554, initiating session
[junit4:junit4]   2> 11675 T660 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:38798
[junit4:junit4]   2> 11675 T660 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:38798
[junit4:junit4]   2> 11676 T662 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b9091c5b9000d with negotiated timeout 10000 for client /127.0.0.1:38798
[junit4:junit4]   2> 11676 T753 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:34554, sessionid = 0x13b9091c5b9000d, negotiated timeout = 10000
[junit4:junit4]   2> 11676 T754 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1719938 name:ZooKeeperConnection Watcher:127.0.0.1:34554/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 11676 T658 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 11678 T658 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2>  C96_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:39249_solr, base_url=http://127.0.0.1:39249/solr}
[junit4:junit4]   2> 11697 T720 C96 P39249 REQ /update {update.distrib=FROMLEADER&_version_=-1421177187057270784&update.from=http://127.0.0.1:54668/solr/collection1/&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2>  C98_STATE=coll:collection1 core:collection1 props:{shard=shard2, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:51298_solr, base_url=http://127.0.0.1:51298/solr}
[junit4:junit4]   2> 11699 T740 C98 P51298 REQ /update {update.distrib=FROMLEADER&_version_=-1421177187065659392&update.from=http://127.0.0.1:37474/solr/collection1/&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11700 T708 C99 P37474 REQ /update {update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=7 
[junit4:junit4]   2> 11700 T693 C97 P54668 /update {wt=javabin&version=2} {deleteByQuery=*:* (-1421177187057270784)} 0 16
[junit4:junit4]   2> 11705 T676 C100 P39923 /update {wt=javabin&version=2} {add=[1 (1421177187076145152)]} 0 2
[junit4:junit4]   2> 11716 T721 C96 P39249 REQ /update {distrib.from=http://127.0.0.1:54668/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11717 T691 C97 P54668 REQ /update {distrib.from=http://127.0.0.1:37474/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=6 
[junit4:junit4]   2> 11717 T705 C99 P37474 /update {wt=javabin&version=2} {add=[1]} 0 10
[junit4:junit4]   2> 11721 T674 C100 P39923 /update {wt=javabin&version=2} {add=[2 (1421177187093970944)]} 0 1
[junit4:junit4]   2> 11734 T737 C98 P51298 REQ /update {distrib.from=http://127.0.0.1:37474/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=3 
[junit4:junit4]   2> 11734 T706 C99 P37474 REQ /update {distrib.from=http://127.0.0.1:54668/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=9 
[junit4:junit4]   2> 11736 T690 C97 P54668 /update {wt=javabin&version=2} {add=[2]} 0 13
[junit4:junit4]   2> 11741 T673 C100 P39923 /update {wt=javabin&version=2} {add=[3 (1421177187113893888)]} 0 3
[junit4:junit4]   2> 11750 T738 C98 P51298 REQ /update {distrib.from=http://127.0.0.1:37474/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11751 T707 C99 P37474 /update {wt=javabin&version=2} {add=[3 (1421177187119136768)]} 0 7
[junit4:junit4]   2> 11755 T675 C100 P39923 /update {wt=javabin&version=2} {add=[4 (1421177187129622528)]} 0 1
[junit4:junit4]   2> 11764 T722 C96 P39249 REQ /update {distrib.from=http://127.0.0.1:54668/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11764 T693 C97 P54668 REQ /update {distrib.from=http://127.0.0.1:37474/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=4 
[junit4:junit4]   2> 11765 T708 C99 P37474 /update {wt=javabin&version=2} {add=[4]} 0 8
[junit4:junit4]   2> 11769 T676 C100 P39923 /update {wt=javabin&version=2} {add=[5 (1421177187144302592)]} 0 2
[junit4:junit4]   2> 11781 T739 C98 P51298 REQ /update {distrib.from=http://127.0.0.1:37474/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11782 T705 C99 P37474 /update {wt=javabin&version=2} {add=[5 (1421177187147448320)]} 0 11
[junit4:junit4]   2> 11786 T674 C100 P39923 /update {wt=javabin&version=2} {add=[6 (1421177187162128384)]} 0 1
[junit4:junit4]   2> 11795 T740 C98 P51298 REQ /update {distrib.from=http://127.0.0.1:37474/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11796 T706 C99 P37474 REQ /update {distrib.from=http://127.0.0.1:54668/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=5 
[junit4:junit4]   2> 11796 T692 C97 P54668 /update {wt=javabin&version=2} {add=[6]} 0 8
[junit4:junit4]   2> 11800 T673 C100 P39923 /update {wt=javabin&version=2} {add=[7 (1421177187176808448)]} 0 1
[junit4:junit4]   2> 11808 T737 C98 P51298 REQ /update {distrib.from=http://127.0.0.1:37474/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11809 T707 C99 P37474 REQ /update {distrib.from=http://127.0.0.1:54668/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=5 
[junit4:junit4]   2> 11809 T690 C97 P54668 /update {wt=javabin&version=2} {add=[7]} 0 7
[junit4:junit4]   2> 11812 T675 C100 P39923 /update {wt=javabin&version=2} {add=[8 (1421177187190439936)]} 0 1
[junit4:junit4]   2> 11820 T723 C96 P39249 REQ /update {distrib.from=http://127.0.0.1:54668/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11821 T693 C97 P54668 REQ /update {distrib.from=http://127.0.0.1:37474/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=5 
[junit4:junit4]   2> 11822 T708 C99 P37474 /update {wt=javabin&version=2} {add=[8]} 0 8
[junit4:junit4]   2> 11825 T676 C100 P39923 /update {wt=javabin&version=2} {add=[9 (1421177187203022848)]} 0 1
[junit4:junit4]   2> 11831 T738 C98 P51298 REQ /update {distrib.from=http://127.0.0.1:37474/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11831 T705 C99 P37474 /update {wt=javabin&version=2} {add=[9 (1421177187206168576)]} 0 4
[junit4:junit4]   2> 11839 T674 C100 P39923 /update {wt=javabin&version=2} {add=[10 (1421177187213508608)]} 0 6
[junit4:junit4]   2> 11845 T721 C96 P39249 REQ /update {distrib.from=http://127.0.0.1:54668/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11845 T691 C97 P54668 /update {wt=javabin&version=2} {add=[10 (1421177187220848640)]} 0 4
[junit4:junit4]   2> 11849 T675 C100 P39923 /update {wt=javabin&version=2} {add=[11 (1421177187228188672)]} 0 1
[junit4:junit4]   2> 11856 T723 C96 P39249 REQ /update {distrib.from=http://127.0.0.1:54668/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11856 T692 C97 P54668 /update {wt=javabin&version=2} {add=[11 (1421177187232382976)]} 0 4
[junit4:junit4]   2> 11859 T676 C100 P39923 /update {wt=javabin&version=2} {add=[12 (1421177187239723008)]} 0 0
[junit4:junit4]   2> 11868 T720 C96 P39249 REQ /update {distrib.from=http://127.0.0.1:54668/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11868 T690 C97 P54668 REQ /update {distrib.from=http://127.0.0.1:37474/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=4 
[junit4:junit4]   2> 11869 T706 C99 P37474 /update {wt=javabin&version=2} {add=[12]} 0 7
[junit4:junit4]   2> 11872 T674 C100 P39923 /update {wt=javabin&version=2} {add=[13 (1421177187252305920)]} 0 1
[junit4:junit4]   2> 11878 T722 C96 P39249 REQ /update {distrib.from=http://127.0.0.1:54668/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11879 T693 C97 P54668 /update {wt=javabin&version=2} {add=[13 (1421177187255451648)]} 0 5
[junit4:junit4]   2> 11882 T673 C100 P39923 /update {wt=javabin&version=2} {add=[14 (1421177187263840256)]} 0 1
[junit4:junit4]   2> 11888 T721 C96 P39249 REQ /update {distrib.from=http://127.0.0.1:54668/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11888 T691 C97 P54668 /update {wt=javabin&version=2} {add=[14 (1421177187265937408)]} 0 4
[junit4:junit4]   2> 11891 T675 C100 P39923 /update {wt=javabin&version=2} {add=[15 (1421177187273277440)]} 0 1
[junit4:junit4]   2> 11899 T723 C96 P39249 REQ /update {distrib.from=http://127.0.0.1:54668/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11899 T692 C97 P54668 REQ /update {distrib.from=http://127.0.0.1:37474/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=4 
[junit4:junit4]   2> 11900 T708 C99 P37474 /update {wt=javabin&version=2} {add=[15]} 0 7
[junit4:junit4]   2> 11903 T676 C100 P39923 /update {wt=javabin&version=2} {add=[16 (1421177187284811776)]} 0 1
[junit4:junit4]   2> 11921 T720 C96 P39249 REQ /update {distrib.from=http://127.0.0.1:54668/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=9 
[junit4:junit4]   2> 11922 T690 C97 P54668 /update {wt=javabin&version=2} {add=[16 (1421177187287957504)]} 0 17
[junit4:junit4]   2> 11927 T674 C100 P39923 /update {wt=javabin&version=2} {add=[17 (1421177187308929024)]} 0 3
[junit4:junit4]   2> 11937 T739 C98 P51298 REQ /update {distrib.from=http://127.0.0.1:37474/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 11938 T705 C99 P37474 /update {wt=javabin&version=2} {add=[17 (1421177187314171904)]} 0 9
[junit4:junit4]   2> 11942 T673 C100 P39923 /update {wt=javabin&version=2} {add=[100 (1421177187325706240)]} 0 1
[junit4:junit4]   2> 11953 T722 C96 P39249 REQ /update {distrib.from=http://127.0.0.1:54668/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 11953 T693 C97 P54668 REQ /update {distrib.from=http://127.0.0.1:37474/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=7 
[junit4:junit4]   2> 11954 T707 C99 P37474 /update {wt=javabin&version=2} {add=[100]} 0 10
[junit4:junit4]   2> 11957 T675 C100 P39923 /update {wt=javabin&version=2} {add=[101 (1421177187342483456)]} 0 1
[junit4:junit4]   2> 11965 T721 C96 P39249 REQ /update {distrib.from=http://127.0.0.1:54668/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11966 T691 C97 P54668 REQ /update {distrib.from=http://127.0.0.1:37474/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=4 
[junit4:junit4]   2> 11966 T706 C99 P37474 /update {wt=javabin&version=2} {add=[101]} 0 6
[junit4:junit4]   2> 11978 T676 C100 P39923 /update {wt=javabin&version=2} {add=[102 (1421177187356114944)]} 0 9
[junit4:junit4]   2> 11986 T723 C96 P39249 REQ /update {distrib.from=http://127.0.0.1:54668/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11986 T692 C97 P54668 REQ /update {distrib.from=http://127.0.0.1:37474/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=3 
[junit4:junit4]   2> 11987 T708 C99 P37474 /update {wt=javabin&version=2} {add=[102]} 0 7
[junit4:junit4]   2> 11991 T674 C100 P39923 /update {wt=javabin&version=2} {add=[103 (1421177187377086464)]} 0 1
[junit4:junit4]   2> 12000 T740 C98 P51298 REQ /update {distrib.from=http://127.0.0.1:37474/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 12000 T705 C99 P37474 REQ /update {distrib.from=http://127.0.0.1:54668/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=4 
[junit4:junit4]   2> 12001 T690 C97 P54668 /update {wt=javabin&version=2} {add=[103]} 0 7
[junit4:junit4]   2> 12004 T673 C100 P39923 /update {wt=javabin&version=2} {add=[104 (1421177187391766528)]} 0 1
[junit4:junit4]   2> 12012 T738 C98 P51298 REQ /update {distrib.from=http://127.0.0.1:37474/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 12013 T706 C99 P37474 REQ /update {distrib.from=http://127.0.0.1:54668/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=4 
[junit4:junit4]   2> 12013 T693 C97 P54668 /update {wt=javabin&version=2} {add=[104]} 0 6
[junit4:junit4]   2> 12016 T675 C100 P39923 /update {wt=javabin&version=2} {add=[105 (1421177187404349440)]} 0 0
[junit4:junit4]   2> 12034 T739 C98 P51298 REQ /update {distrib.from=http://127.0.0.1:37474/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=6 
[junit4:junit4]   2> 12035 T708 C99 P37474 REQ /update {distrib.from=http://127.0.0.1:54668/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=14 
[junit4:junit4]   2> 12036 T691 C97 P54668 /update {wt=javabin&version=2} {add=[105]} 0 17
[junit4:junit4]   2> 12039 T676 C100 P39923 /update {wt=javabin&version=2} {add=[106 (1421177187428466688)]} 0 1
[junit4:junit4]   2> 12049 T737 C98 P51298 REQ /update {distrib.from=http://127.0.0.1:37474/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 12050 T707 C99 P37474 REQ /update {distrib.from=http://127.0.0.1:54668/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=6 
[junit4:junit4]   2> 12051 T692 C97 P54668 /update {wt=javabin&version=2} {add=[106]} 0 10
[junit4:junit4]   2> 12054 T674 C100 P39923 /update {wt=javabin&version=2} {add=[107 (1421177187443146752)]} 0 1
[junit4:junit4]   2> 12061 T720 C96 P39249 REQ /update {distrib.from=http://127.0.0.1:54668/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 12062 T690 C97 P54668 REQ /update {distrib.from=http://127.0.0.1:37474/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=4 
[junit4:junit4]   2> 12063 T705 C99 P37474 /update {wt=javabin&version=2} {add=[107]} 0 7
[junit4:junit4]   2> 12071 T673 C100 P39923 /update {wt=javabin&version=2} {add=[108 (1421177187460972544)]} 0 1
[junit4:junit4]   2> 12077 T722 C96 P39249 REQ /update {distrib.from=http://127.0.0.1:54668/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 12078 T693 C97 P54668 /update {wt=javabin&version=2} {add=[108 (1421177187465166848)]} 0 5
[junit4:junit4]   2> 12082 T675 C100 P39923 /

[...truncated too long message...]

:"collection1",
[junit4:junit4]   1>                 "collection":"control_collection",
[junit4:junit4]   1>                 "node_name":"127.0.0.1:51902_solr",
[junit4:junit4]   1>                 "base_url":"http://127.0.0.1:51902/solr",
[junit4:junit4]   1>                 "leader":"true"}}}}}
[junit4:junit4]   1>  /zookeeper (1)
[junit4:junit4]   1>  DATA:
[junit4:junit4]   1>      
[junit4:junit4]   1> 
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=SyncSliceTest -Dtests.method=testDistribSearch -Dtests.seed=83285C653CB7B51E -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=es_EC -Dtests.timezone=America/Phoenix -Dtests.file.encoding=US-ASCII
[junit4:junit4] FAILURE  583s J1 | SyncSliceTest.testDistribSearch <<<
[junit4:junit4]    > Throwable #1: java.lang.AssertionError: There are still nodes recoverying - waited for 540 seconds
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([83285C653CB7B51E:2CED27D4BE8D522]:0)
[junit4:junit4]    > 	at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:165)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:115)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:110)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:563)
[junit4:junit4]    > 	at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:224)
[junit4:junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
[junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:597)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:662)
[junit4:junit4]   2> 583158 T1001 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> NOTE: test params are: codec=Lucene41: {range_facet_l=PostingsFormat(name=TestBloomFilteredLucene41Postings), text=PostingsFormat(name=MockSep), _version_=PostingsFormat(name=TestBloomFilteredLucene41Postings), rnd_b=PostingsFormat(name=Lucene41WithOrds), intDefault=PostingsFormat(name=TestBloomFilteredLucene41Postings), id=PostingsFormat(name=Lucene41WithOrds), timestamp=PostingsFormat(name=TestBloomFilteredLucene41Postings), a_t=PostingsFormat(name=TestBloomFilteredLucene41Postings), range_facet_sl=PostingsFormat(name=MockSep), range_facet_si=Pulsing41(freqCutoff=10 minBlockSize=84 maxBlockSize=261), other_tl1=PostingsFormat(name=TestBloomFilteredLucene41Postings), multiDefault=Pulsing41(freqCutoff=10 minBlockSize=84 maxBlockSize=261), a_si=Pulsing41(freqCutoff=10 minBlockSize=84 maxBlockSize=261)}, sim=DefaultSimilarity, locale=es_EC, timezone=America/Phoenix
[junit4:junit4]   2> NOTE: Linux 3.2.0-34-generic i386/Sun Microsystems Inc. 1.6.0_37 (32-bit)/cpus=8,threads=1,free=45160376,total=95236096
[junit4:junit4]   2> NOTE: All tests run in this JVM: [TestStressLucene, LeaderElectionTest, TestReplicationHandler, TestCodecSupport, TestCSVResponseWriter, OpenExchangeRatesOrgProviderTest, TestSurroundQueryParser, PrimitiveFieldTypeTest, LukeRequestHandlerTest, UpdateParamsTest, TermVectorComponentTest, TestLRUCache, TestBM25SimilarityFactory, TestQuerySenderListener, StatsComponentTest, EchoParamsTest, XmlUpdateRequestHandlerTest, TestPhraseSuggestions, PrimUtilsTest, XsltUpdateRequestHandlerTest, TestStressRecovery, TestTrie, QueryParsingTest, TestFoldingMultitermQuery, TestSolr4Spatial, TestFuzzyAnalyzedSuggestions, FullSolrCloudDistribCmdsTest, TestHashPartitioner, SchemaVersionSpecificBehaviorTest, ClusterStateUpdateTest, SoftAutoCommitTest, TestOmitPositions, SolrInfoMBeanTest, DOMUtilTest, FieldMutatingUpdateProcessorTest, IndexReaderFactoryTest, RequiredFieldsTest, BasicDistributedZk2Test, SolrIndexConfigTest, TestSolrDeletionPolicy1, TestSolrJ, CoreContainerCoreInitFailuresTest, TestUpdate, TimeZoneUtilsTest, TestFunctionQuery, PathHierarchyTokenizerFactoryTest, TestDocSet, DisMaxRequestHandlerTest, SyncSliceTest]
[junit4:junit4] Completed on J1 in 583.18s, 1 test, 1 failure <<< FAILURES!

[...truncated 39 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:352: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:178: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:438: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1175: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:839: There were test failures: 239 suites, 994 tests, 1 error, 2 failures, 7 ignored (2 assumptions)

Total time: 39 minutes 39 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 32bit/jdk1.6.0_37 -server -XX:+UseConcMarkSweepGC
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-4.x-Linux (32bit/jdk1.7.0_09) - Build # 3187 - Still Failing!

Posted by Policeman Jenkins Server <je...@sd-datasolutions.de>.
Build: http://jenkins.sd-datasolutions.de/job/Lucene-Solr-4.x-Linux/3187/
Java: 32bit/jdk1.7.0_09 -client -XX:+UseSerialGC

3 tests failed.
REGRESSION:  org.apache.solr.cloud.SyncSliceTest.testDistribSearch

Error Message:
There are still nodes recoverying - waited for 540 seconds

Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 540 seconds
	at __randomizedtesting.SeedInfo.seed([F747CC1E4434087E:76A14206336B6842]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:165)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:115)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:110)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:563)
	at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:224)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:601)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)


FAILED:  org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch

Error Message:
There are still nodes recoverying - waited for 540 seconds

Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 540 seconds
	at __randomizedtesting.SeedInfo.seed([F747CC1E4434087E:76A14206336B6842]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:165)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:115)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:110)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:563)
	at org.apache.solr.cloud.BasicDistributedZk2Test.brindDownShardIndexSomeDocsAndRecover(BasicDistributedZk2Test.java:321)
	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:83)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:601)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)


FAILED:  org.apache.solr.cloud.BasicDistributedZkTest.testDistribSearch

Error Message:
Server at http://127.0.0.1:53734/solr returned non ok status:500, message:Server Error

Stack Trace:
org.apache.solr.common.SolrException: Server at http://127.0.0.1:53734/solr returned non ok status:500, message:Server Error
	at __randomizedtesting.SeedInfo.seed([F747CC1E4434087E:76A14206336B6842]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:372)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
	at org.apache.solr.client.solrj.request.CoreAdminRequest.process(CoreAdminRequest.java:429)
	at org.apache.solr.client.solrj.request.CoreAdminRequest.getStatus(CoreAdminRequest.java:472)
	at org.apache.solr.cloud.BasicDistributedZkTest.collectStartTimes(BasicDistributedZkTest.java:959)
	at org.apache.solr.cloud.BasicDistributedZkTest.testCollectionsAPI(BasicDistributedZkTest.java:795)
	at org.apache.solr.cloud.BasicDistributedZkTest.doTest(BasicDistributedZkTest.java:343)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:601)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)




Build Log:
[...truncated 8603 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZkTest
[junit4:junit4]   2> 5 T18 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZkTest-1355335436201
[junit4:junit4]   2> 8 T18 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 10 T19 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 29 T19 oaz.Environment.logEnv Server environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
[junit4:junit4]   2> 29 T19 oaz.Environment.logEnv Server environment:host.name=serv1
[junit4:junit4]   2> 29 T19 oaz.Environment.logEnv Server environment:java.version=1.7.0_09
[junit4:junit4]   2> 30 T19 oaz.Environment.logEnv Server environment:java.vendor=Oracle Corporation
[junit4:junit4]   2> 30 T19 oaz.Environment.logEnv Server environment:java.home=/mnt/ssd/jenkins/tools/java/32bit/jdk1.7.0_09/jre
[junit4:junit4]   2> 30 T19 oaz.Environment.logEnv Server environment:java.class.path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/test:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/codecs/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-solrj/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/common/lucene-analyzers-common-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/highlighter/lucene-highlighter-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/memory/lucene-memory-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/misc/lucene-misc-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/spatial/lucene-spatial-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/suggest/lucene-suggest-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/grouping/lucene-grouping-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queries/lucene-queries-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queryparser/lucene-queryparser-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/cglib-nodep-2.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-cli-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-codec-1.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-fileupload-1.2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-lang-2.6.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/easymock-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/guava-13.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/javax.servlet-api-3.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/metrics-core-2.1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/objenesis-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/spatial4j-0.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/commons-io-2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpclient-4.1.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpcore-4.1.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpmime-4.1.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/jcl-over-slf4j-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/log4j-over-slf4j-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-api-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-jdk14-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/wstx-asl-3.2.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/zookeeper-3.4.5.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-continuation-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-deploy-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-http-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-io-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-jmx-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-security-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-server-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-servlet-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-util-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-webapp-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-xml-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/servlet-api-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/hsqldb-1.8.0.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/junit-4.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/randomizedtesting-runner-2.0.5.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-launcher.jar:/var/lib/jenkins/.ant/lib/ivy-2.2.0.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jdepend.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-netrexx.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-antlr.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-commons-net.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-javamail.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-regexp.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jsch.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-xalan2.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-junit4.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jmf.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-junit.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-bcel.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jai.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-commons-logging.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-resolver.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-oro.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-swing.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-bsf.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-log4j.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-testutil.jar:/mnt/ssd/jenkins/tools/java/32bit/jdk1.7.0_09/lib/tools.jar:/var/lib/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.0.5.jar
[junit4:junit4]   2> 32 T19 oaz.Environment.logEnv Server environment:java.library.path=/usr/lib/jvm/j2sdk1.6-sun/jre/lib/amd64/server:/usr/lib/jvm/j2sdk1.6-sun/jre/lib/amd64:/usr/lib/jvm/j2sdk1.6-sun/jre/../lib/amd64:/usr/java/packages/lib/i386:/lib:/usr/lib
[junit4:junit4]   2> 32 T19 oaz.Environment.logEnv Server environment:java.io.tmpdir=.
[junit4:junit4]   2> 32 T19 oaz.Environment.logEnv Server environment:java.compiler=<NA>
[junit4:junit4]   2> 32 T19 oaz.Environment.logEnv Server environment:os.name=Linux
[junit4:junit4]   2> 33 T19 oaz.Environment.logEnv Server environment:os.arch=i386
[junit4:junit4]   2> 33 T19 oaz.Environment.logEnv Server environment:os.version=3.2.0-34-generic
[junit4:junit4]   2> 33 T19 oaz.Environment.logEnv Server environment:user.name=jenkins
[junit4:junit4]   2> 33 T19 oaz.Environment.logEnv Server environment:user.home=/var/lib/jenkins
[junit4:junit4]   2> 33 T19 oaz.Environment.logEnv Server environment:user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 46 T19 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 46 T19 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4]   2> 46 T19 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4]   2> 51 T19 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 75 T19 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355335436201/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4]   2> 110 T18 oasc.ZkTestServer.run start zk server on port:33593
[junit4:junit4]   2> 134 T18 oaz.Environment.logEnv Client environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
[junit4:junit4]   2> 134 T18 oaz.Environment.logEnv Client environment:host.name=serv1
[junit4:junit4]   2> 135 T18 oaz.Environment.logEnv Client environment:java.version=1.7.0_09
[junit4:junit4]   2> 135 T18 oaz.Environment.logEnv Client environment:java.vendor=Oracle Corporation
[junit4:junit4]   2> 135 T18 oaz.Environment.logEnv Client environment:java.home=/mnt/ssd/jenkins/tools/java/32bit/jdk1.7.0_09/jre
[junit4:junit4]   2> 135 T18 oaz.Environment.logEnv Client environment:java.class.path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/test:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/codecs/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-solrj/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/common/lucene-analyzers-common-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/highlighter/lucene-highlighter-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/memory/lucene-memory-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/misc/lucene-misc-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/spatial/lucene-spatial-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/suggest/lucene-suggest-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/grouping/lucene-grouping-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queries/lucene-queries-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queryparser/lucene-queryparser-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/cglib-nodep-2.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-cli-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-codec-1.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-fileupload-1.2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-lang-2.6.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/easymock-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/guava-13.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/javax.servlet-api-3.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/metrics-core-2.1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/objenesis-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/spatial4j-0.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/commons-io-2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpclient-4.1.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpcore-4.1.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpmime-4.1.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/jcl-over-slf4j-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/log4j-over-slf4j-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-api-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-jdk14-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/wstx-asl-3.2.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/zookeeper-3.4.5.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-continuation-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-deploy-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-http-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-io-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-jmx-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-security-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-server-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-servlet-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-util-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-webapp-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-xml-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/servlet-api-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/hsqldb-1.8.0.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/junit-4.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/randomizedtesting-runner-2.0.5.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-launcher.jar:/var/lib/jenkins/.ant/lib/ivy-2.2.0.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jdepend.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-netrexx.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-antlr.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-commons-net.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-javamail.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-regexp.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jsch.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-xalan2.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-junit4.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jmf.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-junit.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-bcel.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jai.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-commons-logging.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-resolver.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-oro.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-swing.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-bsf.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-log4j.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-testutil.jar:/mnt/ssd/jenkins/tools/java/32bit/jdk1.7.0_09/lib/tools.jar:/var/lib/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.0.5.jar
[junit4:junit4]   2> 137 T18 oaz.Environment.logEnv Client environment:java.library.path=/usr/lib/jvm/j2sdk1.6-sun/jre/lib/amd64/server:/usr/lib/jvm/j2sdk1.6-sun/jre/lib/amd64:/usr/lib/jvm/j2sdk1.6-sun/jre/../lib/amd64:/usr/java/packages/lib/i386:/lib:/usr/lib
[junit4:junit4]   2> 137 T18 oaz.Environment.logEnv Client environment:java.io.tmpdir=.
[junit4:junit4]   2> 137 T18 oaz.Environment.logEnv Client environment:java.compiler=<NA>
[junit4:junit4]   2> 138 T18 oaz.Environment.logEnv Client environment:os.name=Linux
[junit4:junit4]   2> 138 T18 oaz.Environment.logEnv Client environment:os.arch=i386
[junit4:junit4]   2> 138 T18 oaz.Environment.logEnv Client environment:os.version=3.2.0-34-generic
[junit4:junit4]   2> 139 T18 oaz.Environment.logEnv Client environment:user.name=jenkins
[junit4:junit4]   2> 139 T18 oaz.Environment.logEnv Client environment:user.home=/var/lib/jenkins
[junit4:junit4]   2> 139 T18 oaz.Environment.logEnv Client environment:user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 141 T18 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33593 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1f80c8d
[junit4:junit4]   2> 160 T18 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 165 T24 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33593. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 168 T24 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33593, initiating session
[junit4:junit4]   2> 192 T20 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:43585
[junit4:junit4]   2> 200 T20 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:43585
[junit4:junit4]   2> 204 T22 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 215 T22 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b904987f60000 with negotiated timeout 10000 for client /127.0.0.1:43585
[junit4:junit4]   2> 219 T24 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33593, sessionid = 0x13b904987f60000, negotiated timeout = 10000
[junit4:junit4]   2> 223 T25 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f80c8d name:ZooKeeperConnection Watcher:127.0.0.1:33593 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 223 T18 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 224 T18 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 245 T23 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b904987f60000
[junit4:junit4]   2> 246 T25 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 246 T18 oaz.ZooKeeper.close Session: 0x13b904987f60000 closed
[junit4:junit4]   2> 247 T20 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:43585 which had sessionid 0x13b904987f60000
[junit4:junit4]   2> 247 T18 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33593/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@142932c
[junit4:junit4]   2> 248 T18 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 248 T26 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33593. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 249 T26 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33593, initiating session
[junit4:junit4]   2> 249 T20 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:43586
[junit4:junit4]   2> 249 T20 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:43586
[junit4:junit4]   2> 251 T22 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b904987f60001 with negotiated timeout 10000 for client /127.0.0.1:43586
[junit4:junit4]   2> 251 T26 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33593, sessionid = 0x13b904987f60001, negotiated timeout = 10000
[junit4:junit4]   2> 251 T27 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@142932c name:ZooKeeperConnection Watcher:127.0.0.1:33593/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 251 T18 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 258 T18 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 263 T18 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 267 T18 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 270 T18 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 274 T18 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 282 T18 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 290 T18 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 291 T18 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 300 T18 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 301 T18 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 309 T18 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 310 T18 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 314 T18 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 314 T18 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 318 T18 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 318 T18 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 321 T18 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 322 T18 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 326 T18 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 326 T18 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 330 T18 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 331 T18 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 334 T18 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 335 T18 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 339 T23 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b904987f60001
[junit4:junit4]   2> 339 T27 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 339 T20 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:43586 which had sessionid 0x13b904987f60001
[junit4:junit4]   2> 339 T18 oaz.ZooKeeper.close Session: 0x13b904987f60001 closed
[junit4:junit4]   2> 567 T18 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 654 T18 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:33803
[junit4:junit4]   2> 665 T18 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 666 T18 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355335436535
[junit4:junit4]   2> 666 T18 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355335436535/'
[junit4:junit4]   2> 683 T18 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 684 T18 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 684 T18 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355335436535
[junit4:junit4]   2> 685 T18 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355335436535/solr.xml
[junit4:junit4]   2> 685 T18 oasc.CoreContainer.<init> New CoreContainer 7280023
[junit4:junit4]   2> 689 T18 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355335436535/'
[junit4:junit4]   2> 689 T18 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355335436535/'
[junit4:junit4]   2> 713 T18 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 732 T18 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:33593/solr
[junit4:junit4]   2> 743 T18 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 744 T18 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33593 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1a3045a
[junit4:junit4]   2> 745 T18 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 746 T38 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33593. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 747 T38 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33593, initiating session
[junit4:junit4]   2> 747 T20 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:43587
[junit4:junit4]   2> 747 T20 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:43587
[junit4:junit4]   2> 748 T22 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b904987f60002 with negotiated timeout 20000 for client /127.0.0.1:43587
[junit4:junit4]   2> 748 T38 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33593, sessionid = 0x13b904987f60002, negotiated timeout = 20000
[junit4:junit4]   2> 749 T39 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1a3045a name:ZooKeeperConnection Watcher:127.0.0.1:33593 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 749 T18 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 751 T23 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b904987f60002
[junit4:junit4]   2> 751 T39 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 751 T20 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:43587 which had sessionid 0x13b904987f60002
[junit4:junit4]   2> 751 T18 oaz.ZooKeeper.close Session: 0x13b904987f60002 closed
[junit4:junit4]   2> 754 T18 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33593/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@1566ca9
[junit4:junit4]   2> 755 T40 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33593. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 755 T18 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 755 T20 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:43588
[junit4:junit4]   2> 755 T40 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33593, initiating session
[junit4:junit4]   2> 756 T20 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:43588
[junit4:junit4]   2> 757 T22 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b904987f60003 with negotiated timeout 8000 for client /127.0.0.1:43588
[junit4:junit4]   2> 757 T40 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33593, sessionid = 0x13b904987f60003, negotiated timeout = 8000
[junit4:junit4]   2> 757 T41 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1566ca9 name:ZooKeeperConnection Watcher:127.0.0.1:33593/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 758 T18 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 766 T23 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b904987f60003 type:create cxid:0x2 zxid:0x1b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 770 T18 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 772 T18 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33803_solr
[junit4:junit4]   2> 775 T23 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b904987f60003 type:delete cxid:0x7 zxid:0x1d txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:33803_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:33803_solr
[junit4:junit4]   2> 776 T18 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:33803_solr
[junit4:junit4]   2> 779 T18 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 780 T18 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 780 T18 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 780 T18 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 781 T18 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 781 T18 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 781 T18 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 782 T18 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 782 T18 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 783 T18 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 787 T18 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 802 T23 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b904987f60003 type:delete cxid:0x15 zxid:0x22 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 803 T18 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 806 T18 oasc.Overseer.start Overseer (id=88823263151915011-127.0.0.1:33803_solr-n_0000000000) starting
[junit4:junit4]   2> 806 T23 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b904987f60003 type:create cxid:0x1a zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 810 T23 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b904987f60003 type:create cxid:0x1b zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 811 T23 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b904987f60003 type:create cxid:0x1c zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 814 T23 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b904987f60003 type:create cxid:0x1d zxid:0x27 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 815 T43 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
[junit4:junit4]   2> 815 T18 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 818 T18 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 826 T42 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 843 T44 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355335436535/collection1
[junit4:junit4]   2> 843 T44 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4]   2> 844 T44 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 844 T44 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4]   2> 846 T44 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355335436535/collection1/'
[junit4:junit4]   2> 847 T44 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355335436535/collection1/lib/README' to classloader
[junit4:junit4]   2> 850 T44 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355335436535/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 912 T44 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 980 T44 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 981 T44 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 1020 T44 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 1787 T44 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 1798 T44 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 1801 T44 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 1842 T44 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1848 T44 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1852 T44 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1857 T44 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1861 T44 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355335436535/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355335436201/control/data/
[junit4:junit4]   2> 1865 T44 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1b8aff7
[junit4:junit4]   2> 1876 T44 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355335436201/control/data/index/
[junit4:junit4]   2> 1876 T44 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355335436201/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 1879 T44 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355335436201/control/data/index forceNew:false
[junit4:junit4]   2> 1886 T44 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355335436201/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@fd41e0; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 1887 T44 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 1887 T44 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 1926 T44 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 1926 T44 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 1927 T44 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 1929 T44 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 1951 T44 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 1952 T44 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 1953 T44 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 1956 T44 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 1962 T44 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 1974 T44 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 1980 T44 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 1981 T44 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 1982 T44 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 1983 T44 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 1983 T44 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 1985 T44 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 1986 T44 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1987 T44 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1989 T44 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1991 T44 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1993 T44 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1995 T44 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1996 T44 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2004 T44 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 2009 T44 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 2012 T44 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 2013 T44 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 2016 T44 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 2021 T44 oass.SolrIndexSearcher.<init> Opening Searcher@16e16c7 main
[junit4:junit4]   2> 2021 T44 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 2029 T44 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 2030 T44 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 2030 T44 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 2070 T44 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 2178 T45 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@16e16c7 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 2186 T44 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 2186 T44 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 2187 T23 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b904987f60003 type:create cxid:0x56 zxid:0x2a txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 2189 T44 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 2190 T44 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:33803/solr shardId:control_shard
[junit4:junit4]   2> 2193 T44 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4]   2> 2197 T44 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/control_shard/election
[junit4:junit4]   2> 2206 T23 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b904987f60003 type:delete cxid:0x65 zxid:0x31 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4]   2> 2207 T44 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 2207 T23 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b904987f60003 type:create cxid:0x66 zxid:0x32 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2340 T42 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2341 T42 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":"control_shard",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:33803_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:33803/solr"}
[junit4:junit4]   2> 2346 T23 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b904987f60003 type:create cxid:0x6d zxid:0x34 txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 2367 T41 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 2710 T44 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 2710 T44 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 2710 T44 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:33803/solr/collection1/
[junit4:junit4]   2> 2711 T44 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 2711 T44 oasc.SyncStrategy.syncToMe http://127.0.0.1:33803/solr/collection1/ has no replicas
[junit4:junit4]   2> 2711 T44 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:33803/solr/collection1/
[junit4:junit4]   2> 2712 T44 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/control_shard
[junit4:junit4]   2> 2744 T23 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b904987f60003 type:create cxid:0x8c zxid:0x3f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2873 T42 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2886 T41 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 2897 T44 oasc.ZkController.register We are http://127.0.0.1:33803/solr/collection1/ and leader is http://127.0.0.1:33803/solr/collection1/
[junit4:junit4]   2> 2898 T44 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:33803/solr
[junit4:junit4]   2> 2898 T44 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 2898 T44 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 2898 T44 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 2903 T44 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2904 T18 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 2904 T18 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 2922 T18 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 2978 T18 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 2980 T18 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:33768
[junit4:junit4]   2> 2981 T18 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 2981 T18 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355335439123
[junit4:junit4]   2> 2982 T18 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355335439123/'
[junit4:junit4]   2> 3000 T18 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 3000 T18 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 3001 T18 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355335439123
[junit4:junit4]   2> 3001 T18 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355335439123/solr.xml
[junit4:junit4]   2> 3001 T18 oasc.CoreContainer.<init> New CoreContainer 3239398
[junit4:junit4]   2> 3002 T18 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355335439123/'
[junit4:junit4]   2> 3002 T18 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355335439123/'
[junit4:junit4]   2> 3018 T18 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 3038 T18 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:33593/solr
[junit4:junit4]   2> 3039 T18 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 3039 T18 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33593 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1611789
[junit4:junit4]   2> 3040 T18 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3041 T55 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33593. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 3042 T55 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33593, initiating session
[junit4:junit4]   2> 3042 T20 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:43589
[junit4:junit4]   2> 3042 T20 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:43589
[junit4:junit4]   2> 3044 T22 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b904987f60004 with negotiated timeout 20000 for client /127.0.0.1:43589
[junit4:junit4]   2> 3044 T55 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33593, sessionid = 0x13b904987f60004, negotiated timeout = 20000
[junit4:junit4]   2> 3045 T56 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1611789 name:ZooKeeperConnection Watcher:127.0.0.1:33593 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3045 T18 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3047 T23 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b904987f60004
[junit4:junit4]   2> 3047 T56 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 3047 T18 oaz.ZooKeeper.close Session: 0x13b904987f60004 closed
[junit4:junit4]   2> 3047 T20 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:43589 which had sessionid 0x13b904987f60004
[junit4:junit4]   2> 3048 T18 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33593/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@d495d7
[junit4:junit4]   2> 3049 T18 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3049 T57 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33593. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 3050 T57 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33593, initiating session
[junit4:junit4]   2> 3050 T20 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:43590
[junit4:junit4]   2> 3050 T20 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:43590
[junit4:junit4]   2> 3051 T22 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b904987f60005 with negotiated timeout 8000 for client /127.0.0.1:43590
[junit4:junit4]   2> 3052 T57 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33593, sessionid = 0x13b904987f60005, negotiated timeout = 8000
[junit4:junit4]   2> 3052 T58 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d495d7 name:ZooKeeperConnection Watcher:127.0.0.1:33593/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3052 T18 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3053 T23 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b904987f60005 type:create cxid:0x1 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3054 T23 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b904987f60005 type:create cxid:0x2 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3055 T18 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33768_solr
[junit4:junit4]   2> 3056 T23 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b904987f60005 type:delete cxid:0x4 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:33768_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:33768_solr
[junit4:junit4]   2> 3057 T18 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:33768_solr
[junit4:junit4]   2> 3060 T41 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 3060 T41 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3062 T18 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 3062 T18 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 3063 T18 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 3063 T18 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 3064 T18 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 3064 T18 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 3065 T18 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 3065 T18 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 3066 T18 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 3067 T18 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 3076 T18 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3085 T59 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355335439123/collection1
[junit4:junit4]   2> 3086 T59 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 3087 T59 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 3087 T59 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 3088 T59 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355335439123/collection1/'
[junit4:junit4]   2> 3089 T59 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty1-1355335439123/collection1/lib/README' to classloader
[junit4:junit4]   2> 3089 T59 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty1-1355335439123/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 3132 T59 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 3188 T59 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 3189 T59 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 3196 T59 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 3391 T42 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3392 T42 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":"control_shard",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:33803_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:33803/solr"}
[junit4:junit4]   2> 3397 T58 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3397 T41 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3689 T59 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 3700 T59 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 3703 T59 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 3723 T59 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 3728 T59 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 3731 T59 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 3733 T59 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 3735 T59 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355335439123/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355335436201/jetty1/
[junit4:junit4]   2> 3735 T59 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1b8aff7
[junit4:junit4]   2> 3738 T59 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355335436201/jetty1/index/
[junit4:junit4]   2> 3739 T59 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355335436201/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 3739 T59 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355335436201/jetty1/index forceNew:false
[junit4:junit4]   2> 3793 T59 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355335436201/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1f96f20; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 3794 T59 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 3794 T59 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 3796 T59 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 3796 T59 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 3797 T59 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 3797 T59 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 3797 T59 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 3798 T59 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 3798 T59 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 3799 T59 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 3801 T59 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 3803 T59 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 3804 T59 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 3805 T59 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 3806 T59 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 3806 T59 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 3807 T59 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 3808 T59 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 3809 T59 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3810 T59 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3811 T59 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3812 T59 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3813 T59 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3814 T59 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3815 T59 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3816 T59 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 3818 T59 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 3820 T59 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 3822 T59 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 3824 T59 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 3826 T59 oass.SolrIndexSearcher.<init> Opening Searcher@1a91abc main
[junit4:junit4]   2> 3826 T59 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 3827 T59 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 3827 T59 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 3828 T59 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 3893 T59 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 4073 T60 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1a91abc main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 4081 T59 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 4081 T59 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 4410 T42 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4411 T42 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:33768_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:33768/solr"}
[junit4:junit4]   2> 4411 T42 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4]   2> 4413 T42 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 4437 T41 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 4437 T58 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 4583 T59 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 4584 T59 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:33768/solr shardId:shard1
[junit4:junit4]   2> 4585 T59 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 4593 T23 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b904987f60005 type:delete cxid:0x45 zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 4593 T59 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 4594 T23 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b904987f60005 type:create cxid:0x46 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4596 T59 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 4596 T59 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 4596 T59 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:33768/solr/collection1/
[junit4:junit4]   2> 4596 T59 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 4597 T59 oasc.SyncStrategy.syncToMe http://127.0.0.1:33768/solr/collection1/ has no replicas
[junit4:junit4]   2> 4597 T59 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:33768/solr/collection1/
[junit4:junit4]   2> 4597 T59 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 4634 T23 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b904987f60005 type:create cxid:0x50 zxid:0x60 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4941 T42 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5051 T58 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 5052 T41 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 5066 T59 oasc.ZkController.register We are http://127.0.0.1:33768/solr/collection1/ and leader is http://127.0.0.1:33768/solr/collection1/
[junit4:junit4]   2> 5066 T59 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:33768/solr
[junit4:junit4]   2> 5067 T59 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 5067 T59 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 5067 T59 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 5073 T59 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5074 T18 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 5074 T18 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 5074 T18 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 5131 T18 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 5133 T18 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:45115
[junit4:junit4]   2> 5134 T18 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 5134 T18 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355335441273
[junit4:junit4]   2> 5134 T18 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355335441273/'
[junit4:junit4]   2> 5152 T18 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 5153 T18 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 5153 T18 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355335441273
[junit4:junit4]   2> 5153 T18 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355335441273/solr.xml
[junit4:junit4]   2> 5154 T18 oasc.CoreContainer.<init> New CoreContainer 16870278
[junit4:junit4]   2> 5154 T18 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355335441273/'
[junit4:junit4]   2> 5155 T18 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355335441273/'
[junit4:junit4]   2> 5176 T18 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 5190 T18 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:33593/solr
[junit4:junit4]   2> 5191 T18 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 5192 T18 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33593 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1ceb4df
[junit4:junit4]   2> 5193 T70 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33593. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 5193 T18 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 5194 T20 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:43591
[junit4:junit4]   2> 5194 T70 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33593, initiating session
[junit4:junit4]   2> 5195 T20 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:43591
[junit4:junit4]   2> 5197 T22 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b904987f60006 with negotiated timeout 20000 for client /127.0.0.1:43591
[junit4:junit4]   2> 5197 T70 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33593, sessionid = 0x13b904987f60006, negotiated timeout = 20000
[junit4:junit4]   2> 5199 T71 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ceb4df name:ZooKeeperConnection Watcher:127.0.0.1:33593 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 5199 T18 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 5200 T23 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b904987f60006
[junit4:junit4]   2> 5201 T20 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:43591 which had sessionid 0x13b904987f60006
[junit4:junit4]   2> 5201 T71 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 5201 T18 oaz.ZooKeeper.close Session: 0x13b904987f60006 closed
[junit4:junit4]   2> 5202 T18 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33593/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@12ca045
[junit4:junit4]   2> 5203 T18 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 5203 T72 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33593. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 5204 T72 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33593, initiating session
[junit4:junit4]   2> 5204 T20 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:43592
[junit4:junit4]   2> 5204 T20 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:43592
[junit4:junit4]   2> 5205 T22 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b904987f60007 with negotiated timeout 8000 for client /127.0.0.1:43592
[junit4:junit4]   2> 5205 T72 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33593, sessionid = 0x13b904987f60007, negotiated timeout = 8000
[junit4:junit4]   2> 5206 T73 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@12ca045 name:ZooKeeperConnection Watcher:127.0.0.1:33593/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 5206 T18 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 5207 T23 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b904987f60007 type:create cxid:0x1 zxid:0x6d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5208 T23 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b904987f60007 type:create cxid:0x2 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5209 T18 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45115_solr
[junit4:junit4]   2> 5210 T23 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b904987f60007 type:delete cxid:0x4 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:45115_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:45115_solr
[junit4:junit4]   2> 5210 T18 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:45115_solr
[junit4:junit4]   2> 5213 T58 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 5213 T41 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 5213 T58 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5213 T41 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5214 T18 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 5215 T18 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 5215 T18 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 5216 T18 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 5216 T18 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 5216 T18 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 5217 T18 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 5217 T18 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 5217 T18 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 5218 T18 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 5224 T18 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 5231 T74 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355335441273/collection1
[junit4:junit4]   2> 5231 T74 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 5232 T74 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 5232 T74 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 5233 T74 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355335441273/collection1/'
[junit4:junit4]   2> 5233 T74 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty2-1355335441273/collection1/lib/README' to classloader
[junit4:junit4]   2> 5234 T74 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty2-1355335441273/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 5277 T74 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 5333 T74 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 5334 T74 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 5339 T74 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 5558 T42 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5559 T42 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:33768_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:33768/solr"}
[junit4:junit4]   2> 5567 T41 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5567 T58 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5568 T73 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5834 T74 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 5842 T74 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 5845 T74 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 5863 T74 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5867 T74 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5870 T74 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5872 T74 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5874 T74 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355335441273/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355335436201/jetty2/
[junit4:junit4]   2> 5874 T74 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1b8aff7
[junit4:junit4]   2> 5876 T74 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355335436201/jetty2/index/
[junit4:junit4]   2> 5876 T74 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355335436201/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 5877 T74 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355335436201/jetty2/index forceNew:false
[junit4:junit4]   2> 6025 T74 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355335436201/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@7f168d; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 6025 T74 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 6026 T74 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 6027 T74 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 6028 T74 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 6028 T74 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 6029 T74 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 6029 T74 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 6030 T74 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 6030 T74 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 6031 T74 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 6032 T74 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 6033 T74 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 6034 T74 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 6034 T74 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 6035 T74 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 6035 T74 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 6036 T74 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 6037 T74 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 6038 T74 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6038 T74 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6039 T74 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6043 T74 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6044 T74 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6045 T74 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6046 T74 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6047 T74 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 6048 T74 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 6050 T74 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 6052 T74 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 6054 T74 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 6056 T74 oass.SolrIndexSearcher.<init> Opening Searcher@1e337e3 main
[junit4:junit4]   2> 6057 T74 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 6057 T74 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 6058 T74 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 6059 T74 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 6154 T74 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 6361 T75 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1e337e3 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 6373 T74 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 6374 T74 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 6573 T42 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6574 T42 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:45115_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:45115/solr"}
[junit4:junit4]   2> 6575 T42 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 6575 T42 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4]   2> 6587 T41 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 6587 T58 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 6587 T73 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 6876 T74 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 6876 T74 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:45115/solr shardId:shard2
[junit4:junit4]   2> 6877 T74 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4]   2> 6933 T23 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b904987f60007 type:delete cxid:0x44 zxid:0x7e txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard2 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard2
[junit4:junit4]   2> 6942 T74 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 6943 T23 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b904987f60007 type:create cxid:0x45 zxid:0x7f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6944 T74 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 6945 T74 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 6945 T74 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:45115/solr/collection1/
[junit4:junit4]   2> 6945 T74 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 6945 T74 oasc.SyncStrategy.syncToMe http://127.0.0.1:45115/solr/collection1/ has no replicas
[junit4:junit4]   2> 6946 T74 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:45115/solr/collection1/
[junit4:junit4]   2> 6946 T74 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4]   2> 6949 T23 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b904987f60007 type:create cxid:0x4e zxid:0x82 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 7091 T42 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7098 T41 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 7098 T58 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 7098 T73 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 7202 T74 oasc.ZkController.register We are http://127.0.0.1:45115/solr/collection1/ and leader is http://127.0.0.1:45115/solr/collection1/
[junit4:junit4]   2> 7202 T74 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:45115/solr
[junit4:junit4]   2> 7203 T74 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 7203 T74 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 7203 T74 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 7205 T74 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7206 T18 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 7207 T18 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 7208 T18 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 7263 T18 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 7265 T18 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:53734
[junit4:junit4]   2> 7266 T18 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 7266 T18 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355335443408
[junit4:junit4]   2> 7266 T18 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355335443408/'
[junit4:junit4]   2> 7284 T18 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 7284 T18 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 7284 T18 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355335443408
[junit4:junit4]   2> 7285 T18 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355335443408/solr.xml
[junit4:junit4]   2> 7285 T18 oasc.CoreContainer.<init> New CoreContainer 23420996
[junit4:junit4]   2> 7285 T18 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355335443408/'
[junit4:junit4]   2> 7286 T18 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355335443408/'
[junit4:junit4]   2> 7299 T18 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 7312 T18 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:33593/solr
[junit4:junit4]   2> 7313 T18 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 7313 T18 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33593 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@9b955a
[junit4:junit4]   2> 7314 T18 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 7314 T85 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33593. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 7315 T85 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33593, initiating session
[junit4:junit4]   2> 7315 T20 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:43593
[junit4:junit4]   2> 7315 T20 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:43593
[junit4:junit4]   2> 7322 T22 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b904987f60008 with negotiated timeout 20000 for client /127.0.0.1:43593
[junit4:junit4]   2> 7322 T85 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33593, sessionid = 0x13b904987f60008, negotiated timeout = 20000
[junit4:junit4]   2> 7323 T86 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@9b955a name:ZooKeeperConnection Watcher:127.0.0.1:33593 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 7323 T18 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 7324 T23 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b904987f60008
[junit4:junit4]   2> 7325 T86 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 7325 T20 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:43593 which had sessionid 0x13b904987f60008
[junit4:junit4]   2> 7325 T18 oaz.ZooKeeper.close Session: 0x13b904987f60008 closed
[junit4:junit4]   2> 7326 T18 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33593/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@6f1b30
[junit4:junit4]   2> 7326 T18 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 7327 T87 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33593. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 7327 T87 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33593, initiating session
[junit4:junit4]   2> 7327 T20 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:43594
[junit4:junit4]   2> 7328 T20 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:43594
[junit4:junit4]   2> 7329 T22 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b904987f60009 with negotiated timeout 8000 for client /127.0.0.1:43594
[junit4:junit4]   2> 7330 T87 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33593, sessionid = 0x13b904987f60009, negotiated timeout = 8000
[junit4:junit4]   2> 7330 T88 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6f1b30 name:ZooKeeperConnection Watcher:127.0.0.1:33593/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 7330 T18 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 7331 T23 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b904987f60009 type:create cxid:0x1 zxid:0x8f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 7332 T23 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b904987f60009 type:create cxid:0x2 zxid:0x90 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 7333 T18 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53734_solr
[junit4:junit4]   2> 7334 T23 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b904987f60009 type:delete cxid:0x4 zxid:0x91 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:53734_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:53734_solr
[junit4:junit4]   2> 7334 T18 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53734_solr
[junit4:junit4]   2> 7337 T73 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 7337 T58 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 7337 T41 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 7337 T58 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 7340 T41 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 7341 T73 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 7341 T18 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 7342 T18 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 7342 T18 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 7343 T18 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 7343 T18 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 7344 T18 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 7344 T18 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 7344 T18 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 7345 T18 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 7345 T18 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 7363 T18 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 7369 T89 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355335443408/collection1
[junit4:junit4]   2> 7369 T89 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 7370 T89 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 7370 T89 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 7371 T89 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355335443408/collection1/'
[junit4:junit4]   2> 7372 T89 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty3-1355335443408/collection1/lib/README' to classloader
[junit4:junit4]   2> 7372 T89 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty3-1355335443408/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 7414 T89 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 7467 T89 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 7468 T89 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 7477 T89 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 7675 T42 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7676 T42 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:45115_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:45115/solr"}
[junit4:junit4]   2> 7722 T41 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 7722 T73 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 7722 T58 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 7722 T88 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 7985 T89 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 7994 T89 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 7997 T89 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 8013 T89 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 8017 T89 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 8020 T89 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 8021 T89 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 8023 T89 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355335443408/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355335436201/jetty3/
[junit4:junit4]   2> 8023 T89 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1b8aff7
[junit4:junit4]   2> 8024 T89 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355335436201/jetty3/index/
[junit4:junit4]   2> 8025 T89 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355335436201/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 8025 T89 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355335436201/jetty3/index forceNew:false
[junit4:junit4]   2> 8083 T89 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355335436201/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@13e0608; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 8083 T89 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 8084 T89 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 8085 T89 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 8086 T89 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 8086 T89 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 8086 T89 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 8087 T89 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 8087 T89 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 8088 T89 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 8089 T89 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 8090 T89 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 8091 T89 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 8093 T89 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 8094 T89 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 8100 T89 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 8100 T89 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 8101 T89 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 8102 T89 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 8104 T89 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8106 T89 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8108 T89 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8109 T89 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8111 T89 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8112 T89 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8113 T89 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8114 T89 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 8115 T89 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 8117 T89 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 8119 T89 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 8121 T89 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 8123 T89 oass.SolrIndexSearcher.<init> Opening Searcher@1b1f211 main
[junit4:junit4]   2> 8123 T89 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 8124 T89 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 8124 T89 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 8125 T89 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 8185 T89 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 8338 T90 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1b1f211 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 8349 T89 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 8350 T89 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 8731 T42 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8732 T42 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:53734_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:53734/solr"}
[junit4:junit4]   2> 8732 T42 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 8733 T42 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 8736 T58 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 8736 T41 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 8736 T88 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 8736 T73 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 8852 T89 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 8852 T89 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:53734/solr shardId:shard1
[junit4:junit4]   2> 8856 T89 oasc.ZkController.register We are http://127.0.0.1:53734/solr/collection1/ and leader is http://127.0.0.1:33768/solr/collection1/
[junit4:junit4]   2> 8856 T89 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:53734/solr
[junit4:junit4]   2> 8856 T89 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 8857 T89 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C1 name=collection1 org.apache.solr.core.SolrCore@2626da url=http://127.0.0.1:53734/solr/collection1 node=127.0.0.1:53734_solr
[junit4:junit4]   2> 8859 T91 C1 P53734 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 8860 T89 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8860 T91 C1 P53734 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 8860 T91 C1 P53734 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 8861 T91 C1 P53734 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 8861 T18 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 8861 T18 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 8862 T91 C1 P53734 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:33768/solr/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 8862 T18 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 8866 T91 C1 P53734 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4]   2> 8872 T91 C1 P53734 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:53734/solr START replicas=[http://127.0.0.1:33768/solr/collection1/] nUpdates=100
[junit4:junit4]   2> 8876 T91 C1 P53734 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 8877 T91 C1 P53734 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 8877 T91 C1 P53734 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 8877 T91 C1 P53734 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 8936 T18 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 8938 T18 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:42970
[junit4:junit4]   2> 8938 T18 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 8939 T18 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355335445062
[junit4:junit4]   2> 8939 T18 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355335445062/'
[junit4:junit4]   2> 8964 T18 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 8965 T18 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 8965 T18 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355335445062
[junit4:junit4]   2> 8965 T18 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355335445062/solr.xml
[junit4:junit4]   2> 8966 T18 oasc.CoreContainer.<init> New CoreContainer 17703260
[junit4:junit4]   2> 8966 T18 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355335445062/'
[junit4:junit4]   2> 8966 T18 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355335445062/'
[junit4:junit4]   2> 8985 T18 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 9000 T18 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:33593/solr
[junit4:junit4]   2> 9000 T18 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 9001 T18 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33593 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1b0ddf6
[junit4:junit4]   2> 9001 T18 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 9002 T102 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33593. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 9003 T102 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33593, initiating session
[junit4:junit4]   2> 9003 T20 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:43596
[junit4:junit4]   2> 9003 T20 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:43596
[junit4:junit4]   2> 9004 T22 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b904987f6000a with negotiated timeout 20000 for client /127.0.0.1:43596
[junit4:junit4]   2> 9004 T102 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33593, sessionid = 0x13b904987f6000a, negotiated timeout = 20000
[junit4:junit4]   2> 9004 T103 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b0ddf6 name:ZooKeeperConnection Watcher:127.0.0.1:33593 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 9005 T18 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 9006 T23 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b904987f6000a
[junit4:junit4]   2> 9006 T20 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:43596 which had sessionid 0x13b904987f6000a
[junit4:junit4]   2> 9006 T18 oaz.ZooKeeper.close Session: 0x13b904987f6000a closed
[junit4:junit4]   2> 9007 T103 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 9007 T18 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33593/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@1ceb991
[junit4:junit4]   2> 9008 T104 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33593. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 9008 T18 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 9009 T20 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:43597
[junit4:junit4]   2> 9009 T104 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33593, initiating session
[junit4:junit4]   2> 9010 T20 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:43597
[junit4:junit4]   2> 9011 T22 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b904987f6000b with negotiated timeout 8000 for client /127.0.0.1:43597
[junit4:junit4]   2> 9011 T104 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33593, sessionid = 0x13b904987f6000b, negotiated timeout = 8000
[junit4:junit4]   2> 9012 T105 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ceb991 name:ZooKeeperConnection Watcher:127.0.0.1:33593/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 9012 T18 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 9013 T23 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b904987f6000b type:create cxid:0x1 zxid:0xa2 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 9014 T23 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b904987f6000b type:create cxid:0x2 zxid:0xa3 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 9015 T18 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42970_solr
[junit4:junit4]   2> 9016 T23 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b904987f6000b type:delete cxid:0x4 zxid:0xa4 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:42970_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:42970_solr
[junit4:junit4]   2> 9016 T18 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:42970_solr
[junit4:junit4]   2> 9018 T88 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 9018 T73 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 9018 T41 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 9019 T58 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 9019 T41 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9019 T58 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9020 T88 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 9021 T73 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 9021 T18 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 9021 T18 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 9022 T18 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 9022 T18 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 9022 T18 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 9023 T18 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 9023 T18 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 9023 T18 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 9024 T18 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 9024 T18 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 9031 T18 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 9045 T106 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355335445062/collection1
[junit4:junit4]   2> 9046 T106 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 9047 T106 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 9047 T106 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 9051 T106 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355335445062/collection1/'
[junit4:junit4]   2> 9052 T106 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty4-1355335445062/collection1/lib/README' to classloader
[junit4:junit4]   2> 9053 T106 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty4-1355335445062/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 9126 T106 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> ASYNC  NEW_CORE C2 name=collection1 org.apache.solr.core.SolrCore@1056def url=http://127.0.0.1:33768/solr/collection1 node=127.0.0.1:33768_solr
[junit4:junit4]   2> 9157 T52 C2 P33768 REQ /get {distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=4 
[junit4:junit4]   2> 9195 T106 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 9200 T106 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 9207 T106 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 9241 T42 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9242 T42 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:53734_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:53734/solr"}
[junit4:junit4]   2> 9247 T41 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9247 T73 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9247 T58 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9247 T88 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9247 T105 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9676 T106 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 9683 T106 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 9685 T106 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 9700 T106 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 9706 T106 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 9710 T106 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 9711 T106 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 9712 T106 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355335445062/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355335436201/jetty4/
[junit4:junit4]   2> 9712 T106 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1b8aff7
[junit4:junit4]   2> 9713 T106 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355335436201/jetty4/index/
[junit4:junit4]   2> 9713 T106 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355335436201/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 9714 T106 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355335436201/jetty4/index forceNew:false
[junit4:junit4]   2> 9717 T106 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355335436201/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@16ea7b8; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 9717 T106 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 9717 T106 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 9719 T106 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 9719 T106 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 9720 T106 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 9720 T106 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 9720 T106 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 9721 T106 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 9721 T106 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 9722 T106 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 9723 T106 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 9724 T106 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 9725 T106 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 9725 T106 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 9726 T106 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 9727 T106 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 9727 T106 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 9729 T106 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 9730 T106 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9732 T106 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9733 T106 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9734 T106 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9736 T106 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9737 T106 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9739 T106 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9740 T106 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 9742 T106 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 9746 T106 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 9748 T106 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 9750 T106 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 9752 T106 oass.SolrIndexSearcher.<init> Opening Searcher@f4e6ac main
[junit4:junit4]   2> 9752 T106 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 9753 T106 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 9753 T106 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 9753 T106 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 9757 T106 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 9784 T107 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@f4e6ac main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 9790 T106 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 9791 T106 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 10257 T42 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10258 T42 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:42970_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:42970/solr"}
[junit4:junit4]   2> 10259 T42 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 10259 T42 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4]   2> 10262 T41 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10262 T88 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10262 T73 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10262 T105 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10263 T58 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10293 T106 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 10293 T106 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:42970/solr shardId:shard2
[junit4:junit4]   2> 10297 T106 oasc.ZkController.register We are http://127.0.0.1:42970/solr/collection1/ and leader is http://127.0.0.1:45115/solr/collection1/
[junit4:junit4]   2> 10297 T106 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:42970/solr
[junit4:junit4]   2> 10297 T106 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 10298 T106 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C3 name=collection1 org.apache.solr.core.SolrCore@5b8b7f url=http://127.0.0.1:42970/solr/collection1 node=127.0.0.1:42970_solr
[junit4:junit4]   2> 10298 T108 C3 P42970 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 10299 T108 C3 P42970 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 10299 T106 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10299 T108 C3 P42970 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 10299 T108 C3 P42970 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 10300 T18 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 10300 T108 C3 P42970 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:45115/solr/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 10300 T18 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 10301 T108 C3 P42970 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:42970/solr START replicas=[http://127.0.0.1:45115/solr/collection1/] nUpdates=100
[junit4:junit4]   2> 10301 T18 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 10301 T108 C3 P42970 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 10302 T108 C3 P42970 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 10303 T108 C3 P42970 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 10303 T108 C3 P42970 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C4 name=collection1 org.apache.solr.core.SolrCore@17010de url=http://127.0.0.1:45115/solr/collection1 node=127.0.0.1:45115_solr
[junit4:junit4]   2> 10314 T67 C4 P45115 REQ /get {distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=0 
[junit4:junit4]   2> 10315 T18 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33593/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1bc2f85
[junit4:junit4]   2> 10316 T110 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33593. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 10316 T18 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 10317 T110 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33593, initiating session
[junit4:junit4]   2> 10317 T20 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:43602
[junit4:junit4]   2> 10317 T20 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:43602
[junit4:junit4]   2> 10318 T22 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b904987f6000c with negotiated timeout 10000 for client /127.0.0.1:43602
[junit4:junit4]   2> 10318 T110 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33593, sessionid = 0x13b904987f6000c, negotiated timeout = 10000
[junit4:junit4]   2> 10318 T111 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1bc2f85 name:ZooKeeperConnection Watcher:127.0.0.1:33593/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 10318 T18 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 10319 T18 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 10322 T18 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 10323 T18 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 10327 T18 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10328 T18 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):540
[junit4:junit4]   2> 10329 T18 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10767 T42 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10768 T42 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:42970_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:42970/solr"}
[junit4:junit4]   2> 10772 T58 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10772 T111 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10772 T41 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10772 T73 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10772 T88 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10772 T105 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 11331 T18 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2>  C1_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:53734_solr, base_url=http://127.0.0.1:53734/solr}
[junit4:junit4]   2> 12155 T91 C1 P53734 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 12156 T91 C1 P53734 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 12156 T91 C1 P53734 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:33768/solr/collection1/. core=collection1
[junit4:junit4]   2> 12156 T91 C1 P53734 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 12164 T54 C2 P33768 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16
[junit4:junit4]   2> 12170 T54 C2 P33768 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 12173 T54 C2 P33768 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355335436201/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1f96f20; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 12173 T54 C2 P33768 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 12181 T54 C2 P33768 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355335436201/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1f96f20; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355335436201/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1f96f20; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 12182 T54 C2 P33768 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 12188 T54 C2 P33768 oass.SolrIndexSearcher.<init> Opening Searcher@af5c74 realtime
[junit4:junit4]   2> 12189 T54 C2 P33768 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 12189 T54 C2 P33768 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 12189 T54 C2 P33768 /update {waitSearcher=true&openSearcher=false&commit=true&commit_end_point=true&wt=javabin&softCommit=false&version=2} {commit=} 0 27
[junit4:junit4]   2> 12205 T91 C1 P53734 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 12206 T91 C1 P53734 oascsi.HttpClientUtil.createClient Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
[junit4:junit4]   2> 12211 T91 C1 P53734 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 12228 T52 C2 P33768 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 12229 T52 C2 P33768 REQ /replication {command=indexversion&wt=javabin&qt=/replication&version=2} status=0 QTime=17 
[junit4:junit4]   2> 12230 T91 C1 P53734 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 12230 T91 C1 P53734 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 12231 T91 C1 P53734 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 12234 T53 C2 P33768 REQ /replication {command=filelist&generation=2&wt=javabin&qt=/replication&version=2} status=0 QTime=1 
[junit4:junit4]   2> 12235 T91 C1 P53734 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 12237 T91 C1 P53734 oash.SnapPuller.fetchLatestIndex Starting download to ./org.apache.solr.cloud.BasicDistributedZkTest-1355335436201/jetty3/index.20121213010408431 fullCopy=true
[junit4:junit4]   2> 12245 T54 C2 P33768 REQ /replication {file=segments_2&command=filecontent&checksum=true&generation=2&qt=/replication&wt=filestream} status=0 QTime=3 
[junit4:junit4]   2> 12337 T18 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 12342 T91 C1 P53734 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 12351 T91 C1 P53734 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20121213010408431
[junit4:junit4]   2> 12355 T91 C1 P53734 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.BasicDistributedZkTest-1355335436201/jetty3/index/ new=./org.apache.solr.cloud.BasicDistributedZkTest-1355335436201/jetty3/index.20121213010408431
[junit4:junit4]   2> 12356 T91 C1 P53734 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355335436201/jetty3/index.20121213010408431 forceNew:false
[junit4:junit4]   2> 12357 T91 C1 P53734 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355335436201/jetty3/index.20121213010408431 lockFactory=org.apache.lucene.store.NativeFSLockFactory@658dc1; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 12357 T91 C1 P53734 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 12359 T91 C1 P53734 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 12359 T91 C1 P53734 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 12359 T91 C1 P53734 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4]   2> 12360 T91 C1 P53734 oasc.CachingDirectoryFactory.close Closing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355335436201/jetty3/index.20121213010408431
[junit4:junit4]   2> 12360 T91 C1 P53734 oash.SnapPuller$2.onClose removing old index directory ./org.apache.solr.cloud.BasicDistributedZkTest-1355335436201/jetty3/index
[junit4:junit4]   2> 12361 T91 C1 P53734 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355335436201/jetty3/index.20121213010408431 forceNew:true
[junit4:junit4]   2> 12362 T91 C1 P53734 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355335436201/jetty3/index.20121213010408431 lockFactory=org.apache.lucene.store.NativeFSLockFactory@bfa5d0; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 12362 T91 C1 P53734 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 12363 T91 C1 P53734 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 12363 T91 C1 P53734 oass.SolrIndexSearcher.<init> Opening Searcher@1968100 main
[junit4:junit4]   2> 12363 T91 C1 P53734 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 12366 T90 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1968100 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 12366 T91 C1 P53734 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 12393 T91 C1 P53734 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355335436201/jetty3/index.20121213010408431 lockFactory=org.apache.lucene.store.NativeFSLockFactory@bfa5d0; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355335436201/jetty3/index.20121213010408431 lockFactory=org.apache.lucene.store.NativeFSLockFactory@bfa5d0; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 12393 T91 C1 P53734 oasc.SolrDeletionPolicy.updateCommits newest commit = 3
[junit4:junit4]   2> 12394 T91 C1 P53734 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 12394 T91 C1 P53734 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 12394 T91 C1 P53734 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 12394 T91 C1 P53734 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 12394 T91 C1 P53734 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 12396 T91 C1 P53734 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 12842 T42 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 12843 T42 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:53734_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:53734/solr"}
[junit4:junit4]   2> 12851 T41 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 12851 T111 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 12852 T88 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 12852 T58 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 12851 T73 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 12851 T105 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2>  C3_STATE=coll:collection1 core:collection1 props:{shard=shard2, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:42970_solr, base_url=http://127.0.0.1:42970/solr}
[junit4:junit4]   2> 13316 T108 C3 P42970 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 13317 T108 C3 P42970 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 13317 T108 C3 P42970 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:45115/solr/collection1/. core=collection1
[junit4:junit4]   2> 13317 T108 C3 P42970 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 13323 T68 C4 P45115 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 13325 T68 C4 P45115 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355335436201/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@7f168d; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 13325 T68 C4 P45115 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 13331 T68 C4 P45115 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355335436201/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@7f168d; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355335436201/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@7f168d; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 13332 T68 C4 P45115 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 13333 T68 C4 P45115 oass.SolrIndexSearcher.<init> Opening Searcher@253bbd realtime
[junit4:junit4]   2> 13333 T68 C4 P45115 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 13333 T68 C4 P45115 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 13334 T68 C4 P45115 /update {waitSearcher=true&openSearcher=false&commit=true&commit_end_point=true&wt=javabin&softCommit=false&version=2} {commit=} 0 11
[junit4:junit4]   2> 13335 T108 C3 P42970 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 13336 T108 C3 P42970 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 13338 T66 C4 P45115 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 13339 T66 C4 P45115 REQ /replication {command=indexversion&wt=javabin&qt=/replication&version=2} status=0 QTime=2 
[junit4:junit4]   2> 13339 T18 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 13340 T108 C3 P42970 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 13340 T108 C3 P42970 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 13340 T108 C3 P42970 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 13343 T69 C4 P45115 REQ /replication {command=filelist&generation=2&wt=javabin&qt=/replication&version=2} status=0 QTime=1 
[junit4:junit4]   2> 13343 T108 C3 P42970 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 13344 T108 C3 P42970 oash.SnapPuller.fetchLatestIndex Starting download to ./org.apache.solr.cloud.BasicDistributedZkTest-1355335436201/jetty4/index.20121213010409539 fullCopy=true
[junit4:junit4]   2> 13347 T68 C4 P45115 REQ /replication {file=segments_2&command=filecontent&checksum=true&generation=2&qt=/replication&wt=filestream} status=0 QTime=1 
[junit4:junit4]   2> 13349 T108 C3 P42970 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 13361 T108 C3 P42970 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20121213010409539
[junit4:junit4]   2> 13362 T108 C3 P42970 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.BasicDistributedZkTest-1355335436201/jetty4/index/ new=./org.apache.solr.cloud.BasicDistributedZkTest-1355335436201/jetty4/index.20121213010409539
[junit4:junit4]   2> 13367 T108 C3 P42970 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355335436201/jetty4/index.20121213010409539 forceNew:false
[junit4:junit4]   2> 13369 T108 C3 P42970 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355335436201/jetty4/index.20121213010409539 lockFactory=org.apache.lucene.store.NativeFSLockFactory@13de0c1; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 13369 T108 C3 P42970 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 13369 T108 C3 P42970 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 13370 T108 C3 P42970 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 13370 T108 C3 P42970 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4]   2> 13371 T108 C3 P42970 oasc.CachingDirectoryFactory.close Closing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355335436201/jetty4/index.20121213010409539
[junit4:junit4]   2> 13371 T108 C3 P42970 oash.SnapPuller$2.onClose removing old index directory ./org.apache.solr.cloud.BasicDistributedZkTest-1355335436201/jetty4/index
[junit4:junit4]   2> 13372 T108 C3 P42970 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355335436201/jetty4/index.20121213010409539 forceNew:true
[junit4:junit4]   2> 13373 T108 C3 P42970 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355335436201/jetty4/index.20121213010409539 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3c5ccc; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 13374 T108 C3 P42970 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 13374 T108 C3 P42970 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 13374 T108 C3 P42970 oass.SolrIndexSearcher.<init> Opening Searcher@e19f53 main
[junit4:junit4]   2> 13374 T108 C3 P42970 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 13377 T107 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@e19f53 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 13377 T108 C3 P42970 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 13403 T108 C3 P42970 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355335436201/jetty4/index.20121213010409539 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3c5ccc; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355335436201/jetty4/index.20121213010409539 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3c5ccc; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 13404 T108 C3 P42970 oasc.SolrDeletionPolicy.updateCommits newest commit = 3
[junit4:junit4]   2> 13404 T108 C3 P42970 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 13404 T108 C3 P42970 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 13405 T108 C3 P42970 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 13405 T108 C3 P42970 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 13405 T108 C3 P42970 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 13406 T108 C3 P42970 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 13859 T42 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 13860 T42 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:42970_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:42970/solr"}
[junit4:junit4]   2> 13864 T41 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 13864 T58 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 13864 T73 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 13864 T88 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 13864 T111 oascc.ZkStateReader$2.process A cluster state change has occurre

[...truncated too long message...]

         "base_url":"http://127.0.0.1:33479/solr",
[junit4:junit4]   1>                 "leader":"true"}}}}}
[junit4:junit4]   1>  /zookeeper (1)
[junit4:junit4]   1>  DATA:
[junit4:junit4]   1>      
[junit4:junit4]   1> 
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=SyncSliceTest -Dtests.method=testDistribSearch -Dtests.seed=F747CC1E4434087E -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=fr_BE -Dtests.timezone=Zulu -Dtests.file.encoding=UTF-8
[junit4:junit4] FAILURE  580s J0 | SyncSliceTest.testDistribSearch <<<
[junit4:junit4]    > Throwable #1: java.lang.AssertionError: There are still nodes recoverying - waited for 540 seconds
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([F747CC1E4434087E:76A14206336B6842]:0)
[junit4:junit4]    > 	at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:165)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:115)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:110)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:563)
[junit4:junit4]    > 	at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:224)
[junit4:junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:601)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 580122 T1910 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> NOTE: test params are: codec=Asserting, sim=DefaultSimilarity, locale=fr_BE, timezone=Zulu
[junit4:junit4]   2> NOTE: Linux 3.2.0-34-generic i386/Oracle Corporation 1.7.0_09 (32-bit)/cpus=8,threads=1,free=143977104,total=518979584
[junit4:junit4]   2> NOTE: All tests run in this JVM: [SampleTest, PluginInfoTest, BasicDistributedZkTest, TestConfig, TestBadConfig, TestIndexingPerformance, ScriptEngineTest, HighlighterConfigTest, TestXIncludeConfig, ZkControllerTest, TestJoin, TestLuceneMatchVersion, BadComponentTest, SpellPossibilityIteratorTest, MinimalSchemaTest, TestLFUCache, JSONWriterTest, SpellCheckCollatorTest, SolrCoreCheckLockOnStartupTest, SolrRequestParserTest, TestRandomFaceting, TestReload, TestBinaryResponseWriter, TestExtendedDismaxParser, SuggesterWFSTTest, TestSolrQueryParser, WordBreakSolrSpellCheckerTest, TestFastOutputStream, NumericFieldsTest, DistanceFunctionTest, CacheHeaderTest, SearchHandlerTest, SolrPluginUtilsTest, CircularListTest, FileBasedSpellCheckerTest, TestQuerySenderNoQuery, TestQueryTypes, TestStressVersions, TestElisionMultitermQuery, TermsComponentTest, SpellCheckComponentTest, TestSystemIdResolver, SimpleFacetsTest, UniqFieldsUpdateProcessorFactoryTest, TestSolrIndexConfig, SuggesterFSTTest, AnalysisAfterCoreReloadTest, CopyFieldTest, MBeansHandlerTest, SOLR749Test, NoCacheHeaderTest, TestSearchPerf, QueryElevationComponentTest, SystemInfoHandlerTest, TestLMDirichletSimilarityFactory, UpdateRequestProcessorFactoryTest, SortByFunctionTest, DirectSolrConnectionTest, TestWordDelimiterFilterFactory, MoreLikeThisHandlerTest, DistributedQueryElevationComponentTest, DisMaxRequestHandlerTest, IndexSchemaTest, SolrInfoMBeanTest, FieldAnalysisRequestHandlerTest, JsonLoaderTest, DirectUpdateHandlerOptimizeTest, TestValueSourceCache, TestReversedWildcardFilterFactory, ReturnFieldsTest, RequiredFieldsTest, TestQueryUtils, SuggesterTSTTest, SuggesterTest, CSVRequestHandlerTest, NotRequiredUniqueKeyTest, BadIndexSchemaTest, PrimitiveFieldTypeTest, AlternateDirectoryTest, TestBinaryField, TestPropInjectDefaults, TestQuerySenderListener, OutputWriterTest, TestJmxMonitoredMap, EchoParamsTest, TestPerFieldSimilarity, TestIBSimilarityFactory, TestFastLRUCache, URLClassifyProcessorTest, DateFieldTest, TestSuggestSpellingConverter, ZkNodePropsTest, ClusterStateTest, OverseerCollectionProcessorTest, SyncSliceTest]
[junit4:junit4] Completed on J0 in 580.14s, 1 test, 1 failure <<< FAILURES!

[...truncated 47 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:352: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:178: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:438: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1175: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:839: There were test failures: 239 suites, 994 tests, 1 error, 2 failures, 7 ignored (2 assumptions)

Total time: 37 minutes 4 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 32bit/jdk1.7.0_09 -client -XX:+UseSerialGC
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-4.x-Linux (32bit/jdk1.7.0_09) - Build # 3186 - Still Failing!

Posted by Policeman Jenkins Server <je...@sd-datasolutions.de>.
Build: http://jenkins.sd-datasolutions.de/job/Lucene-Solr-4.x-Linux/3186/
Java: 32bit/jdk1.7.0_09 -server -XX:+UseSerialGC

2 tests failed.
FAILED:  org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch

Error Message:
There are still nodes recoverying - waited for 540 seconds

Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 540 seconds
	at __randomizedtesting.SeedInfo.seed([9276FF091583F295:1390711162DC92A9]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:165)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:115)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:110)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:563)
	at org.apache.solr.cloud.BasicDistributedZk2Test.brindDownShardIndexSomeDocsAndRecover(BasicDistributedZk2Test.java:321)
	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:83)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:601)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)


FAILED:  org.apache.solr.cloud.BasicDistributedZkTest.testDistribSearch

Error Message:
Server at http://127.0.0.1:53224/solr returned non ok status:500, message:Server Error

Stack Trace:
org.apache.solr.common.SolrException: Server at http://127.0.0.1:53224/solr returned non ok status:500, message:Server Error
	at __randomizedtesting.SeedInfo.seed([9276FF091583F295:1390711162DC92A9]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:372)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
	at org.apache.solr.client.solrj.request.CoreAdminRequest.process(CoreAdminRequest.java:429)
	at org.apache.solr.client.solrj.request.CoreAdminRequest.getStatus(CoreAdminRequest.java:472)
	at org.apache.solr.cloud.BasicDistributedZkTest.collectStartTimes(BasicDistributedZkTest.java:959)
	at org.apache.solr.cloud.BasicDistributedZkTest.testCollectionsAPI(BasicDistributedZkTest.java:795)
	at org.apache.solr.cloud.BasicDistributedZkTest.doTest(BasicDistributedZkTest.java:343)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:601)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)




Build Log:
[...truncated 8803 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZkTest
[junit4:junit4]   2> 3 T1017 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZkTest-1355331647831
[junit4:junit4]   2> 4 T1017 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 4 T1018 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 5 T1018 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 5 T1018 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4]   2> 5 T1018 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4]   2> 6 T1018 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 6 T1018 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355331647830/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4]   2> 104 T1017 oasc.ZkTestServer.run start zk server on port:35949
[junit4:junit4]   2> 105 T1017 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:35949 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1409598
[junit4:junit4]   2> 106 T1023 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:35949. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 106 T1017 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 106 T1023 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:35949, initiating session
[junit4:junit4]   2> 106 T1019 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:53140
[junit4:junit4]   2> 107 T1019 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:53140
[junit4:junit4]   2> 107 T1021 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 194 T1021 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b900fb95a0000 with negotiated timeout 10000 for client /127.0.0.1:53140
[junit4:junit4]   2> 194 T1023 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:35949, sessionid = 0x13b900fb95a0000, negotiated timeout = 10000
[junit4:junit4]   2> 196 T1024 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1409598 name:ZooKeeperConnection Watcher:127.0.0.1:35949 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 197 T1017 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 197 T1017 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 200 T1022 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b900fb95a0000
[junit4:junit4]   2> 201 T1019 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53140 which had sessionid 0x13b900fb95a0000
[junit4:junit4]   2> 201 T1017 oaz.ZooKeeper.close Session: 0x13b900fb95a0000 closed
[junit4:junit4]   2> 202 T1017 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:35949/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@269d35
[junit4:junit4]   2> 203 T1024 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 203 T1025 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:35949. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 203 T1025 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:35949, initiating session
[junit4:junit4]   2> 204 T1019 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:53142
[junit4:junit4]   2> 204 T1019 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:53142
[junit4:junit4]   2> 204 T1017 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 205 T1021 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b900fb95a0001 with negotiated timeout 10000 for client /127.0.0.1:53142
[junit4:junit4]   2> 205 T1025 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:35949, sessionid = 0x13b900fb95a0001, negotiated timeout = 10000
[junit4:junit4]   2> 205 T1026 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@269d35 name:ZooKeeperConnection Watcher:127.0.0.1:35949/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 206 T1017 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 206 T1017 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 209 T1017 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 211 T1017 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 214 T1017 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 216 T1017 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 217 T1017 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 233 T1017 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 234 T1017 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 238 T1017 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 239 T1017 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 242 T1017 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 242 T1017 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 245 T1017 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 246 T1017 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 248 T1017 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 249 T1017 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 251 T1017 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 252 T1017 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 254 T1017 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 255 T1017 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 257 T1017 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 258 T1017 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 260 T1017 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 261 T1017 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 263 T1022 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b900fb95a0001
[junit4:junit4]   2> 263 T1026 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 263 T1019 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53142 which had sessionid 0x13b900fb95a0001
[junit4:junit4]   2> 263 T1017 oaz.ZooKeeper.close Session: 0x13b900fb95a0001 closed
[junit4:junit4]   2> 318 T1017 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 321 T1017 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:53224
[junit4:junit4]   2> 321 T1017 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 322 T1017 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355331648091
[junit4:junit4]   2> 322 T1017 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355331648091/'
[junit4:junit4]   2> 334 T1017 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 335 T1017 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 335 T1017 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355331648091
[junit4:junit4]   2> 335 T1017 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355331648091/solr.xml
[junit4:junit4]   2> 336 T1017 oasc.CoreContainer.<init> New CoreContainer 16124405
[junit4:junit4]   2> 336 T1017 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355331648091/'
[junit4:junit4]   2> 336 T1017 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355331648091/'
[junit4:junit4]   2> 349 T1017 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 357 T1017 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:35949/solr
[junit4:junit4]   2> 358 T1017 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 358 T1017 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:35949 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1ca33fc
[junit4:junit4]   2> 359 T1036 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:35949. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 359 T1017 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 359 T1036 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:35949, initiating session
[junit4:junit4]   2> 359 T1019 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:53143
[junit4:junit4]   2> 360 T1019 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:53143
[junit4:junit4]   2> 360 T1021 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b900fb95a0002 with negotiated timeout 20000 for client /127.0.0.1:53143
[junit4:junit4]   2> 360 T1036 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:35949, sessionid = 0x13b900fb95a0002, negotiated timeout = 20000
[junit4:junit4]   2> 361 T1037 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ca33fc name:ZooKeeperConnection Watcher:127.0.0.1:35949 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 361 T1017 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 362 T1022 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b900fb95a0002
[junit4:junit4]   2> 362 T1037 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 362 T1019 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53143 which had sessionid 0x13b900fb95a0002
[junit4:junit4]   2> 362 T1017 oaz.ZooKeeper.close Session: 0x13b900fb95a0002 closed
[junit4:junit4]   2> 363 T1017 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:35949/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@36daf
[junit4:junit4]   2> 364 T1038 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:35949. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 364 T1017 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 364 T1038 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:35949, initiating session
[junit4:junit4]   2> 364 T1019 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:53144
[junit4:junit4]   2> 364 T1019 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:53144
[junit4:junit4]   2> 365 T1021 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b900fb95a0003 with negotiated timeout 8000 for client /127.0.0.1:53144
[junit4:junit4]   2> 365 T1038 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:35949, sessionid = 0x13b900fb95a0003, negotiated timeout = 8000
[junit4:junit4]   2> 365 T1039 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@36daf name:ZooKeeperConnection Watcher:127.0.0.1:35949/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 365 T1017 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 367 T1022 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b900fb95a0003 type:create cxid:0x2 zxid:0x1b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 368 T1017 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 369 T1017 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53224_solr
[junit4:junit4]   2> 370 T1022 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b900fb95a0003 type:delete cxid:0x7 zxid:0x1d txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:53224_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:53224_solr
[junit4:junit4]   2> 371 T1017 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53224_solr
[junit4:junit4]   2> 373 T1017 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 373 T1017 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 373 T1017 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 374 T1017 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 374 T1017 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 374 T1017 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 375 T1017 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 375 T1017 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 376 T1017 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 376 T1017 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 379 T1017 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 383 T1022 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b900fb95a0003 type:delete cxid:0x15 zxid:0x22 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 384 T1017 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 386 T1017 oasc.Overseer.start Overseer (id=88823014872449027-127.0.0.1:53224_solr-n_0000000000) starting
[junit4:junit4]   2> 386 T1022 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b900fb95a0003 type:create cxid:0x1a zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 387 T1022 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b900fb95a0003 type:create cxid:0x1b zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 387 T1022 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b900fb95a0003 type:create cxid:0x1c zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 388 T1022 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b900fb95a0003 type:create cxid:0x1d zxid:0x27 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 389 T1041 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
[junit4:junit4]   2> 389 T1017 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 391 T1017 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 393 T1040 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 395 T1042 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355331648091/collection1
[junit4:junit4]   2> 396 T1042 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4]   2> 396 T1042 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 396 T1042 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4]   2> 397 T1042 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355331648091/collection1/'
[junit4:junit4]   2> 398 T1042 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355331648091/collection1/lib/README' to classloader
[junit4:junit4]   2> 398 T1042 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355331648091/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 422 T1042 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 458 T1042 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 459 T1042 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 462 T1042 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 804 T1042 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 809 T1042 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 811 T1042 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 822 T1042 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 825 T1042 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 828 T1042 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 829 T1042 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 830 T1042 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355331648091/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355331647830/control/data/
[junit4:junit4]   2> 830 T1042 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@500202
[junit4:junit4]   2> 837 T1042 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355331647830/control/data/index/
[junit4:junit4]   2> 837 T1042 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355331647830/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 838 T1042 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355331647830/control/data/index forceNew:false
[junit4:junit4]   2> 841 T1042 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355331647830/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@d30363; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 841 T1042 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 851 T1042 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 853 T1042 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 853 T1042 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 854 T1042 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 854 T1042 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 854 T1042 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 855 T1042 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 855 T1042 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 856 T1042 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 857 T1042 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 857 T1042 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 858 T1042 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 859 T1042 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 859 T1042 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 860 T1042 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 860 T1042 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 861 T1042 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 861 T1042 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 862 T1042 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 863 T1042 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 864 T1042 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 864 T1042 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 865 T1042 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 866 T1042 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 867 T1042 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 867 T1042 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 871 T1042 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 874 T1042 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 876 T1042 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 879 T1042 oass.SolrIndexSearcher.<init> Opening Searcher@1cec04e main
[junit4:junit4]   2> 879 T1042 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 880 T1042 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 880 T1042 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 880 T1042 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 884 T1042 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 911 T1043 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1cec04e main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 916 T1042 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 916 T1042 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 917 T1022 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b900fb95a0003 type:create cxid:0x53 zxid:0x2a txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 919 T1042 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 919 T1042 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:53224/solr shardId:control_shard
[junit4:junit4]   2> 920 T1042 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/control_shard/election
[junit4:junit4]   2> 932 T1022 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b900fb95a0003 type:delete cxid:0x62 zxid:0x31 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4]   2> 933 T1042 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 933 T1022 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b900fb95a0003 type:create cxid:0x63 zxid:0x32 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1397 T1040 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 1397 T1040 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":"control_shard",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:53224_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:53224/solr"}
[junit4:junit4]   2> 1398 T1022 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b900fb95a0003 type:create cxid:0x6a zxid:0x34 txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 1405 T1039 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 1435 T1042 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 1435 T1042 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 1435 T1042 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:53224/solr/collection1/
[junit4:junit4]   2> 1436 T1042 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 1436 T1042 oasc.SyncStrategy.syncToMe http://127.0.0.1:53224/solr/collection1/ has no replicas
[junit4:junit4]   2> 1436 T1042 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:53224/solr/collection1/
[junit4:junit4]   2> 1436 T1042 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/control_shard
[junit4:junit4]   2> 1440 T1022 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b900fb95a0003 type:create cxid:0x89 zxid:0x3f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1910 T1040 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 1914 T1039 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 1943 T1042 oasc.ZkController.register We are http://127.0.0.1:53224/solr/collection1/ and leader is http://127.0.0.1:53224/solr/collection1/
[junit4:junit4]   2> 1943 T1042 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:53224/solr
[junit4:junit4]   2> 1943 T1042 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 1943 T1042 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 1944 T1042 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 1945 T1042 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 1946 T1017 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 1946 T1017 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 1947 T1017 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 2013 T1017 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 2014 T1017 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:45436
[junit4:junit4]   2> 2015 T1017 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 2015 T1017 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355331649778
[junit4:junit4]   2> 2016 T1017 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355331649778/'
[junit4:junit4]   2> 2027 T1017 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 2028 T1017 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 2028 T1017 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355331649778
[junit4:junit4]   2> 2029 T1017 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355331649778/solr.xml
[junit4:junit4]   2> 2029 T1017 oasc.CoreContainer.<init> New CoreContainer 12239508
[junit4:junit4]   2> 2029 T1017 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355331649778/'
[junit4:junit4]   2> 2030 T1017 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355331649778/'
[junit4:junit4]   2> 2042 T1017 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 2050 T1017 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:35949/solr
[junit4:junit4]   2> 2050 T1017 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 2051 T1017 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:35949 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1cf3b52
[junit4:junit4]   2> 2052 T1053 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:35949. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 2051 T1017 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2052 T1053 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:35949, initiating session
[junit4:junit4]   2> 2052 T1019 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:53145
[junit4:junit4]   2> 2053 T1019 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:53145
[junit4:junit4]   2> 2053 T1021 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b900fb95a0004 with negotiated timeout 20000 for client /127.0.0.1:53145
[junit4:junit4]   2> 2053 T1053 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:35949, sessionid = 0x13b900fb95a0004, negotiated timeout = 20000
[junit4:junit4]   2> 2054 T1054 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1cf3b52 name:ZooKeeperConnection Watcher:127.0.0.1:35949 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2054 T1017 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2055 T1022 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b900fb95a0004
[junit4:junit4]   2> 2056 T1054 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 2056 T1019 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53145 which had sessionid 0x13b900fb95a0004
[junit4:junit4]   2> 2056 T1017 oaz.ZooKeeper.close Session: 0x13b900fb95a0004 closed
[junit4:junit4]   2> 2056 T1017 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:35949/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@b1ace2
[junit4:junit4]   2> 2057 T1055 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:35949. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 2057 T1017 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2058 T1055 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:35949, initiating session
[junit4:junit4]   2> 2058 T1019 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:53146
[junit4:junit4]   2> 2058 T1019 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:53146
[junit4:junit4]   2> 2059 T1021 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b900fb95a0005 with negotiated timeout 8000 for client /127.0.0.1:53146
[junit4:junit4]   2> 2059 T1055 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:35949, sessionid = 0x13b900fb95a0005, negotiated timeout = 8000
[junit4:junit4]   2> 2059 T1056 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b1ace2 name:ZooKeeperConnection Watcher:127.0.0.1:35949/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2059 T1017 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2060 T1022 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b900fb95a0005 type:create cxid:0x1 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2060 T1022 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b900fb95a0005 type:create cxid:0x2 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2061 T1017 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45436_solr
[junit4:junit4]   2> 2062 T1022 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b900fb95a0005 type:delete cxid:0x4 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:45436_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:45436_solr
[junit4:junit4]   2> 2062 T1017 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:45436_solr
[junit4:junit4]   2> 2064 T1039 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 2064 T1039 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 2065 T1017 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 2065 T1017 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 2066 T1017 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 2066 T1017 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 2066 T1017 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 2067 T1017 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 2067 T1017 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 2068 T1017 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 2068 T1017 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 2068 T1017 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 2074 T1017 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 2079 T1057 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355331649778/collection1
[junit4:junit4]   2> 2079 T1057 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 2080 T1057 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 2080 T1057 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 2081 T1057 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355331649778/collection1/'
[junit4:junit4]   2> 2081 T1057 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty1-1355331649778/collection1/lib/README' to classloader
[junit4:junit4]   2> 2082 T1057 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty1-1355331649778/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 2105 T1057 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 2138 T1057 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 2139 T1057 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 2155 T1057 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 2417 T1040 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2418 T1040 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":"control_shard",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:53224_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:53224/solr"}
[junit4:junit4]   2> 2421 T1039 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 2421 T1056 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 2469 T1057 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 2485 T1057 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 2487 T1057 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 2496 T1057 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 2499 T1057 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 2502 T1057 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 2503 T1057 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 2504 T1057 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355331649778/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355331647830/jetty1/
[junit4:junit4]   2> 2504 T1057 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@500202
[junit4:junit4]   2> 2504 T1057 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355331647830/jetty1/index/
[junit4:junit4]   2> 2505 T1057 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355331647830/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 2505 T1057 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355331647830/jetty1/index forceNew:false
[junit4:junit4]   2> 2509 T1057 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355331647830/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@113ce0b; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 2509 T1057 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 2509 T1057 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 2511 T1057 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 2511 T1057 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 2511 T1057 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 2512 T1057 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 2512 T1057 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 2513 T1057 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 2513 T1057 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 2514 T1057 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 2515 T1057 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 2516 T1057 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 2516 T1057 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 2517 T1057 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 2517 T1057 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 2518 T1057 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 2518 T1057 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 2519 T1057 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 2520 T1057 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2520 T1057 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2521 T1057 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2522 T1057 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2523 T1057 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2524 T1057 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2524 T1057 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2525 T1057 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 2526 T1057 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 2529 T1057 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 2532 T1057 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 2533 T1057 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 2535 T1057 oass.SolrIndexSearcher.<init> Opening Searcher@1c8d6ed main
[junit4:junit4]   2> 2536 T1057 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 2536 T1057 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 2537 T1057 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 2537 T1057 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 2541 T1057 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 2567 T1058 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1c8d6ed main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 2572 T1057 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 2573 T1057 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 2926 T1040 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2927 T1040 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:45436_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:45436/solr"}
[junit4:junit4]   2> 2927 T1040 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4]   2> 2929 T1040 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 2933 T1039 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 2933 T1056 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3074 T1057 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 3075 T1057 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:45436/solr shardId:shard1
[junit4:junit4]   2> 3075 T1057 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 3081 T1022 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b900fb95a0005 type:delete cxid:0x45 zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 3081 T1057 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 3082 T1022 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b900fb95a0005 type:create cxid:0x46 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3083 T1057 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 3083 T1057 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 3084 T1057 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:45436/solr/collection1/
[junit4:junit4]   2> 3084 T1057 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 3084 T1057 oasc.SyncStrategy.syncToMe http://127.0.0.1:45436/solr/collection1/ has no replicas
[junit4:junit4]   2> 3084 T1057 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:45436/solr/collection1/
[junit4:junit4]   2> 3084 T1057 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 3087 T1022 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b900fb95a0005 type:create cxid:0x50 zxid:0x60 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3436 T1040 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3504 T1056 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3504 T1039 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3539 T1057 oasc.ZkController.register We are http://127.0.0.1:45436/solr/collection1/ and leader is http://127.0.0.1:45436/solr/collection1/
[junit4:junit4]   2> 3540 T1057 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:45436/solr
[junit4:junit4]   2> 3540 T1057 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 3540 T1057 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 3540 T1057 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 3541 T1057 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3542 T1017 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 3543 T1017 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 3543 T1017 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 3621 T1017 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 3624 T1017 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:33310
[junit4:junit4]   2> 3625 T1017 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 3625 T1017 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355331651374
[junit4:junit4]   2> 3626 T1017 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355331651374/'
[junit4:junit4]   2> 3641 T1017 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 3641 T1017 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 3641 T1017 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355331651374
[junit4:junit4]   2> 3642 T1017 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355331651374/solr.xml
[junit4:junit4]   2> 3642 T1017 oasc.CoreContainer.<init> New CoreContainer 19434271
[junit4:junit4]   2> 3643 T1017 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355331651374/'
[junit4:junit4]   2> 3643 T1017 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355331651374/'
[junit4:junit4]   2> 3656 T1017 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 3665 T1017 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:35949/solr
[junit4:junit4]   2> 3665 T1017 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 3666 T1017 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:35949 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1f51815
[junit4:junit4]   2> 3667 T1017 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3667 T1068 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:35949. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 3668 T1068 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:35949, initiating session
[junit4:junit4]   2> 3668 T1019 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:53148
[junit4:junit4]   2> 3668 T1019 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:53148
[junit4:junit4]   2> 3669 T1021 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b900fb95a0006 with negotiated timeout 20000 for client /127.0.0.1:53148
[junit4:junit4]   2> 3669 T1068 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:35949, sessionid = 0x13b900fb95a0006, negotiated timeout = 20000
[junit4:junit4]   2> 3669 T1069 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f51815 name:ZooKeeperConnection Watcher:127.0.0.1:35949 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3669 T1017 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3670 T1022 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b900fb95a0006
[junit4:junit4]   2> 3671 T1069 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 3671 T1019 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53148 which had sessionid 0x13b900fb95a0006
[junit4:junit4]   2> 3671 T1017 oaz.ZooKeeper.close Session: 0x13b900fb95a0006 closed
[junit4:junit4]   2> 3671 T1017 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:35949/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@1be3491
[junit4:junit4]   2> 3672 T1070 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:35949. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 3672 T1017 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3673 T1070 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:35949, initiating session
[junit4:junit4]   2> 3673 T1019 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:53149
[junit4:junit4]   2> 3673 T1019 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:53149
[junit4:junit4]   2> 3674 T1021 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b900fb95a0007 with negotiated timeout 8000 for client /127.0.0.1:53149
[junit4:junit4]   2> 3674 T1070 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:35949, sessionid = 0x13b900fb95a0007, negotiated timeout = 8000
[junit4:junit4]   2> 3674 T1071 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1be3491 name:ZooKeeperConnection Watcher:127.0.0.1:35949/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3674 T1017 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3675 T1022 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b900fb95a0007 type:create cxid:0x1 zxid:0x6d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3676 T1022 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b900fb95a0007 type:create cxid:0x2 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3676 T1017 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33310_solr
[junit4:junit4]   2> 3677 T1022 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b900fb95a0007 type:delete cxid:0x4 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:33310_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:33310_solr
[junit4:junit4]   2> 3677 T1017 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:33310_solr
[junit4:junit4]   2> 3679 T1056 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 3680 T1039 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 3680 T1056 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 3680 T1039 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 3681 T1017 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 3681 T1017 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 3682 T1017 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 3682 T1017 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 3682 T1017 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 3683 T1017 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 3683 T1017 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 3683 T1017 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 3684 T1017 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 3684 T1017 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 3689 T1017 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3694 T1072 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355331651374/collection1
[junit4:junit4]   2> 3694 T1072 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 3695 T1072 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 3695 T1072 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 3696 T1072 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355331651374/collection1/'
[junit4:junit4]   2> 3696 T1072 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty2-1355331651374/collection1/lib/README' to classloader
[junit4:junit4]   2> 3697 T1072 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty2-1355331651374/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 3721 T1072 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 3769 T1072 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 3770 T1072 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 3774 T1072 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 4009 T1040 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4010 T1040 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:45436_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:45436/solr"}
[junit4:junit4]   2> 4013 T1071 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4013 T1039 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4013 T1056 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4096 T1072 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 4101 T1072 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 4103 T1072 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 4113 T1072 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 4116 T1072 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 4119 T1072 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 4120 T1072 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 4121 T1072 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355331651374/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355331647830/jetty2/
[junit4:junit4]   2> 4121 T1072 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@500202
[junit4:junit4]   2> 4122 T1072 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355331647830/jetty2/index/
[junit4:junit4]   2> 4122 T1072 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355331647830/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 4122 T1072 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355331647830/jetty2/index forceNew:false
[junit4:junit4]   2> 4155 T1072 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355331647830/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1c4e7a5; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 4155 T1072 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 4156 T1072 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 4157 T1072 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 4157 T1072 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 4157 T1072 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 4158 T1072 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 4158 T1072 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 4158 T1072 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 4158 T1072 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 4159 T1072 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 4160 T1072 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 4160 T1072 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 4161 T1072 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 4161 T1072 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 4162 T1072 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 4162 T1072 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 4162 T1072 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 4163 T1072 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 4163 T1072 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4164 T1072 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4164 T1072 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4165 T1072 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4165 T1072 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4166 T1072 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4167 T1072 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4167 T1072 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 4168 T1072 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 4170 T1072 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 4171 T1072 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 4173 T1072 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 4174 T1072 oass.SolrIndexSearcher.<init> Opening Searcher@12614f3 main
[junit4:junit4]   2> 4175 T1072 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 4175 T1072 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 4175 T1072 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 4176 T1072 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 4179 T1072 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 4203 T1073 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@12614f3 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 4207 T1072 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 4207 T1072 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 4517 T1040 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4518 T1040 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:33310_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:33310/solr"}
[junit4:junit4]   2> 4518 T1040 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 4519 T1040 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4]   2> 4534 T1039 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4534 T1071 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4534 T1056 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4708 T1072 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 4708 T1072 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:33310/solr shardId:shard2
[junit4:junit4]   2> 4709 T1072 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4]   2> 4714 T1022 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b900fb95a0007 type:delete cxid:0x44 zxid:0x7e txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard2 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard2
[junit4:junit4]   2> 4714 T1072 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 4715 T1022 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b900fb95a0007 type:create cxid:0x45 zxid:0x7f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4716 T1072 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 4717 T1072 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 4717 T1072 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:33310/solr/collection1/
[junit4:junit4]   2> 4717 T1072 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 4717 T1072 oasc.SyncStrategy.syncToMe http://127.0.0.1:33310/solr/collection1/ has no replicas
[junit4:junit4]   2> 4718 T1072 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:33310/solr/collection1/
[junit4:junit4]   2> 4718 T1072 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4]   2> 4721 T1022 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b900fb95a0007 type:create cxid:0x4e zxid:0x82 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5039 T1040 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5045 T1039 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5045 T1056 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5045 T1071 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5073 T1072 oasc.ZkController.register We are http://127.0.0.1:33310/solr/collection1/ and leader is http://127.0.0.1:33310/solr/collection1/
[junit4:junit4]   2> 5073 T1072 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:33310/solr
[junit4:junit4]   2> 5074 T1072 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 5074 T1072 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 5074 T1072 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 5076 T1072 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5077 T1017 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 5078 T1017 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 5078 T1017 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 5142 T1017 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 5144 T1017 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:36991
[junit4:junit4]   2> 5145 T1017 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 5145 T1017 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355331652909
[junit4:junit4]   2> 5146 T1017 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355331652909/'
[junit4:junit4]   2> 5157 T1017 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 5158 T1017 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 5158 T1017 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355331652909
[junit4:junit4]   2> 5159 T1017 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355331652909/solr.xml
[junit4:junit4]   2> 5159 T1017 oasc.CoreContainer.<init> New CoreContainer 5805436
[junit4:junit4]   2> 5160 T1017 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355331652909/'
[junit4:junit4]   2> 5160 T1017 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355331652909/'
[junit4:junit4]   2> 5173 T1017 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 5181 T1017 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:35949/solr
[junit4:junit4]   2> 5181 T1017 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 5182 T1017 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:35949 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@16e612a
[junit4:junit4]   2> 5183 T1083 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:35949. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 5183 T1017 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 5184 T1083 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:35949, initiating session
[junit4:junit4]   2> 5184 T1019 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:53150
[junit4:junit4]   2> 5184 T1019 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:53150
[junit4:junit4]   2> 5185 T1021 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b900fb95a0008 with negotiated timeout 20000 for client /127.0.0.1:53150
[junit4:junit4]   2> 5185 T1083 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:35949, sessionid = 0x13b900fb95a0008, negotiated timeout = 20000
[junit4:junit4]   2> 5185 T1084 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@16e612a name:ZooKeeperConnection Watcher:127.0.0.1:35949 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 5185 T1017 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 5187 T1022 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b900fb95a0008
[junit4:junit4]   2> 5187 T1084 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 5188 T1019 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53150 which had sessionid 0x13b900fb95a0008
[junit4:junit4]   2> 5187 T1017 oaz.ZooKeeper.close Session: 0x13b900fb95a0008 closed
[junit4:junit4]   2> 5188 T1017 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:35949/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@1f7726a
[junit4:junit4]   2> 5189 T1085 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:35949. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 5189 T1017 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 5189 T1085 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:35949, initiating session
[junit4:junit4]   2> 5189 T1019 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:53151
[junit4:junit4]   2> 5190 T1019 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:53151
[junit4:junit4]   2> 5191 T1021 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b900fb95a0009 with negotiated timeout 8000 for client /127.0.0.1:53151
[junit4:junit4]   2> 5191 T1085 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:35949, sessionid = 0x13b900fb95a0009, negotiated timeout = 8000
[junit4:junit4]   2> 5191 T1086 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f7726a name:ZooKeeperConnection Watcher:127.0.0.1:35949/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 5191 T1017 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 5192 T1022 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b900fb95a0009 type:create cxid:0x1 zxid:0x8f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5193 T1022 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b900fb95a0009 type:create cxid:0x2 zxid:0x90 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5194 T1017 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36991_solr
[junit4:junit4]   2> 5195 T1022 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b900fb95a0009 type:delete cxid:0x4 zxid:0x91 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:36991_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:36991_solr
[junit4:junit4]   2> 5195 T1017 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:36991_solr
[junit4:junit4]   2> 5197 T1071 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5197 T1039 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 5197 T1056 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 5197 T1039 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5198 T1056 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5198 T1017 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 5199 T1071 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 5199 T1017 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 5199 T1017 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 5200 T1017 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 5200 T1017 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 5200 T1017 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 5201 T1017 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 5201 T1017 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 5202 T1017 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 5202 T1017 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 5207 T1017 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 5212 T1087 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355331652909/collection1
[junit4:junit4]   2> 5212 T1087 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 5213 T1087 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 5213 T1087 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 5214 T1087 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355331652909/collection1/'
[junit4:junit4]   2> 5214 T1087 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty3-1355331652909/collection1/lib/README' to classloader
[junit4:junit4]   2> 5214 T1087 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty3-1355331652909/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 5240 T1087 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 5291 T1087 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 5292 T1087 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 5295 T1087 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 5578 T1040 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5579 T1040 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:33310_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:33310/solr"}
[junit4:junit4]   2> 5587 T1039 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5587 T1056 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5587 T1071 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5587 T1086 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5633 T1087 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 5639 T1087 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 5642 T1087 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 5657 T1087 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5660 T1087 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5663 T1087 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5664 T1087 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5665 T1087 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355331652909/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355331647830/jetty3/
[junit4:junit4]   2> 5665 T1087 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@500202
[junit4:junit4]   2> 5666 T1087 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355331647830/jetty3/index/
[junit4:junit4]   2> 5666 T1087 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355331647830/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 5666 T1087 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355331647830/jetty3/index forceNew:false
[junit4:junit4]   2> 5705 T1087 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355331647830/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@ddd5fb; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 5705 T1087 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 5706 T1087 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 5707 T1087 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 5707 T1087 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 5707 T1087 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 5708 T1087 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 5708 T1087 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 5708 T1087 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 5709 T1087 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 5709 T1087 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 5710 T1087 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 5711 T1087 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 5711 T1087 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 5712 T1087 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 5712 T1087 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 5712 T1087 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 5713 T1087 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 5713 T1087 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 5714 T1087 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5714 T1087 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5715 T1087 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5716 T1087 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5716 T1087 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5717 T1087 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5717 T1087 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5718 T1087 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 5719 T1087 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 5721 T1087 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 5722 T1087 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 5724 T1087 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 5725 T1087 oass.SolrIndexSearcher.<init> Opening Searcher@1f40c50 main
[junit4:junit4]   2> 5726 T1087 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 5726 T1087 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 5726 T1087 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 5727 T1087 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 5730 T1087 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 5750 T1088 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1f40c50 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 5754 T1087 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 5754 T1087 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 6092 T1040 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6093 T1040 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:36991_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:36991/solr"}
[junit4:junit4]   2> 6093 T1040 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 6093 T1040 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 6097 T1056 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6097 T1039 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6097 T1086 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6097 T1071 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6256 T1087 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 6256 T1087 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:36991/solr shardId:shard1
[junit4:junit4]   2> 6258 T1087 oasc.ZkController.register We are http://127.0.0.1:36991/solr/collection1/ and leader is http://127.0.0.1:45436/solr/collection1/
[junit4:junit4]   2> 6259 T1087 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:36991/solr
[junit4:junit4]   2> 6259 T1087 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 6259 T1087 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C99 name=collection1 org.apache.solr.core.SolrCore@9bf88b url=http://127.0.0.1:36991/solr/collection1 node=127.0.0.1:36991_solr
[junit4:junit4]   2> 6262 T1089 C99 P36991 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 6262 T1087 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6263 T1089 C99 P36991 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 6263 T1089 C99 P36991 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 6263 T1089 C99 P36991 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 6263 T1017 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 6264 T1017 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 6264 T1089 C99 P36991 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:45436/solr/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 6264 T1017 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 6268 T1089 C99 P36991 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4]   2> 6274 T1089 C99 P36991 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:36991/solr START replicas=[http://127.0.0.1:45436/solr/collection1/] nUpdates=100
[junit4:junit4]   2> 6274 T1089 C99 P36991 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 6275 T1089 C99 P36991 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 6275 T1089 C99 P36991 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 6275 T1089 C99 P36991 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C100 name=collection1 org.apache.solr.core.SolrCore@d5e3b2 url=http://127.0.0.1:45436/solr/collection1 node=127.0.0.1:45436_solr
[junit4:junit4]   2> 6280 T1050 C100 P45436 REQ /get {distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=0 
[junit4:junit4]   2> 6326 T1017 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 6328 T1017 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:41314
[junit4:junit4]   2> 6328 T1017 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 6329 T1017 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355331654095
[junit4:junit4]   2> 6329 T1017 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355331654095/'
[junit4:junit4]   2> 6340 T1017 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 6341 T1017 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 6341 T1017 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355331654095
[junit4:junit4]   2> 6341 T1017 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355331654095/solr.xml
[junit4:junit4]   2> 6342 T1017 oasc.CoreContainer.<init> New CoreContainer 13851748
[junit4:junit4]   2> 6342 T1017 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355331654095/'
[junit4:junit4]   2> 6342 T1017 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355331654095/'
[junit4:junit4]   2> 6354 T1017 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 6362 T1017 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:35949/solr
[junit4:junit4]   2> 6362 T1017 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 6363 T1017 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:35949 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1876f6a
[junit4:junit4]   2> 6364 T1100 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:35949. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 6364 T1017 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6364 T1100 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:35949, initiating session
[junit4:junit4]   2> 6364 T1019 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:53155
[junit4:junit4]   2> 6365 T1019 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:53155
[junit4:junit4]   2> 6366 T1021 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b900fb95a000a with negotiated timeout 20000 for client /127.0.0.1:53155
[junit4:junit4]   2> 6366 T1100 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:35949, sessionid = 0x13b900fb95a000a, negotiated timeout = 20000
[junit4:junit4]   2> 6367 T1101 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1876f6a name:ZooKeeperConnection Watcher:127.0.0.1:35949 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6367 T1017 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6368 T1022 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b900fb95a000a
[junit4:junit4]   2> 6369 T1019 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53155 which had sessionid 0x13b900fb95a000a
[junit4:junit4]   2> 6369 T1101 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 6369 T1017 oaz.ZooKeeper.close Session: 0x13b900fb95a000a closed
[junit4:junit4]   2> 6372 T1017 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:35949/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@d146bd
[junit4:junit4]   2> 6373 T1102 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:35949. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 6373 T1017 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6373 T1102 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:35949, initiating session
[junit4:junit4]   2> 6373 T1019 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:53156
[junit4:junit4]   2> 6374 T1019 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:53156
[junit4:junit4]   2> 6374 T1021 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b900fb95a000b with negotiated timeout 8000 for client /127.0.0.1:53156
[junit4:junit4]   2> 6374 T1102 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:35949, sessionid = 0x13b900fb95a000b, negotiated timeout = 8000
[junit4:junit4]   2> 6375 T1103 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d146bd name:ZooKeeperConnection Watcher:127.0.0.1:35949/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6375 T1017 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6376 T1022 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b900fb95a000b type:create cxid:0x1 zxid:0xa2 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6377 T1022 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b900fb95a000b type:create cxid:0x2 zxid:0xa3 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6378 T1017 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41314_solr
[junit4:junit4]   2> 6378 T1022 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b900fb95a000b type:delete cxid:0x4 zxid:0xa4 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:41314_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:41314_solr
[junit4:junit4]   2> 6379 T1017 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:41314_solr
[junit4:junit4]   2> 6381 T1071 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6381 T1086 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 6381 T1086 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6381 T1056 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 6381 T1039 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 6382 T1056 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6382 T1039 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6383 T1071 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 6382 T1017 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 6383 T1017 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 6383 T1017 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 6384 T1017 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 6384 T1017 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 6385 T1017 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 6385 T1017 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 6386 T1017 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 6386 T1017 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 6387 T1017 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 6394 T1017 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 6400 T1104 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355331654095/collection1
[junit4:junit4]   2> 6400 T1104 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 6401 T1104 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 6401 T1104 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 6402 T1104 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355331654095/collection1/'
[junit4:junit4]   2> 6402 T1104 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty4-1355331654095/collection1/lib/README' to classloader
[junit4:junit4]   2> 6402 T1104 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty4-1355331654095/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 6430 T1104 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 6484 T1104 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 6485 T1104 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 6488 T1104 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 6601 T1040 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6601 T1040 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:36991_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:36991/solr"}
[junit4:junit4]   2> 6614 T1056 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6614 T1071 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6614 T1039 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6614 T1086 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6614 T1103 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6816 T1104 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 6821 T1104 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 6823 T1104 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 6833 T1104 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 6836 T1104 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 6839 T1104 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 6840 T1104 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 6842 T1104 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355331654095/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355331647830/jetty4/
[junit4:junit4]   2> 6842 T1104 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@500202
[junit4:junit4]   2> 6842 T1104 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355331647830/jetty4/index/
[junit4:junit4]   2> 6843 T1104 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355331647830/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 6843 T1104 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355331647830/jetty4/index forceNew:false
[junit4:junit4]   2> 6846 T1104 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355331647830/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@176dae; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 6846 T1104 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 6846 T1104 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 6848 T1104 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 6848 T1104 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 6848 T1104 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 6848 T1104 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 6849 T1104 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 6849 T1104 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 6849 T1104 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 6850 T1104 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 6850 T1104 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 6851 T1104 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 6852 T1104 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 6852 T1104 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 6852 T1104 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 6853 T1104 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 6853 T1104 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 6853 T1104 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 6854 T1104 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6855 T1104 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6855 T1104 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6856 T1104 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6856 T1104 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6857 T1104 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6857 T1104 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6858 T1104 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 6859 T1104 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 6861 T1104 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 6862 T1104 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 6864 T1104 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 6865 T1104 oass.SolrIndexSearcher.<init> Opening Searcher@64aa8 main
[junit4:junit4]   2> 6865 T1104 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 6866 T1104 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 6866 T1104 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 6867 T1104 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 6870 T1104 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 6896 T1105 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@64aa8 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 6901 T1104 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 6902 T1104 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 7120 T1040 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7120 T1040 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:41314_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:41314/solr"}
[junit4:junit4]   2> 7120 T1040 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 7121 T1040 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4]   2> 7125 T1086 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7125 T1056 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7125 T1039 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7125 T1071 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7125 T1103 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7403 T1104 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 7403 T1104 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:41314/solr shardId:shard2
[junit4:junit4]   2> 7406 T1104 oasc.ZkController.register We are http://127.0.0.1:41314/solr/collection1/ and leader is http://127.0.0.1:33310/solr/collection1/
[junit4:junit4]   2> 7406 T1104 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:41314/solr
[junit4:junit4]   2> 7406 T1104 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 7406 T1104 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C101 name=collection1 org.apache.solr.core.SolrCore@1b216a1 url=http://127.0.0.1:41314/solr/collection1 node=127.0.0.1:41314_solr
[junit4:junit4]   2> 7407 T1106 C101 P41314 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 7407 T1106 C101 P41314 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 7407 T1104 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7407 T1106 C101 P41314 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 7408 T1106 C101 P41314 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 7408 T1017 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 7409 T1106 C101 P41314 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:33310/solr/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 7409 T1106 C101 P41314 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:41314/solr START replicas=[http://127.0.0.1:33310/solr/collection1/] nUpdates=100
[junit4:junit4]   2> 7409 T1017 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 7409 T1106 C101 P41314 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 7409 T1017 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 7409 T1106 C101 P41314 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 7410 T1106 C101 P41314 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 7410 T1106 C101 P41314 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C102 name=collection1 org.apache.solr.core.SolrCore@16ad9d url=http://127.0.0.1:33310/solr/collection1 node=127.0.0.1:33310_solr
[junit4:junit4]   2> 7415 T1064 C102 P33310 REQ /get {distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=1 
[junit4:junit4]   2> 7415 T1017 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:35949/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1d7f8c6
[junit4:junit4]   2> 7416 T1108 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:35949. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 7416 T1017 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 7416 T1108 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:35949, initiating session
[junit4:junit4]   2> 7417 T1019 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:53158
[junit4:junit4]   2> 7417 T1019 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:53158
[junit4:junit4]   2> 7418 T1021 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b900fb95a000c with negotiated timeout 10000 for client /127.0.0.1:53158
[junit4:junit4]   2> 7418 T1108 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:35949, sessionid = 0x13b900fb95a000c, negotiated timeout = 10000
[junit4:junit4]   2> 7418 T1109 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1d7f8c6 name:ZooKeeperConnection Watcher:127.0.0.1:35949/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 7418 T1017 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 7420 T1017 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 7422 T1017 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 7423 T1017 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 7426 T1017 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7427 T1017 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):540
[junit4:junit4]   2> 7428 T1017 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7631 T1040 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7632 T1040 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:41314_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:41314/solr"}
[junit4:junit4]   2> 7754 T1109 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7754 T1056 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7754 T1039 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7754 T1086 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7754 T1103 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7754 T1071 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8430 T1017 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2>  C99_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:36991_solr, base_url=http://127.0.0.1:36991/solr}
[junit4:junit4]   2> 9286 T1089 C99 P36991 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 9286 T1089 C99 P36991 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 9287 T1089 C99 P36991 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:45436/solr/collection1/. core=collection1
[junit4:junit4]   2> 9287 T1089 C99 P36991 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 9292 T1050 C100 P45436 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 9295 T1050 C100 P45436 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355331647830/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@113ce0b; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 9296 T1050 C100 P45436 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 9303 T1050 C100 P45436 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355331647830/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@113ce0b; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355331647830/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@113ce0b; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 9304 T1050 C100 P45436 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 9305 T1050 C100 P45436 oass.SolrIndexSearcher.<init> Opening Searcher@7bfd40 realtime
[junit4:junit4]   2> 9306 T1050 C100 P45436 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 9306 T1050 C100 P45436 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 9307 T1050 C100 P45436 /update {waitSearcher=true&openSearcher=false&commit=true&commit_end_point=true&wt=javabin&softCommit=false&version=2} {commit=} 0 15
[junit4:junit4]   2> 9309 T1089 C99 P36991 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 9310 T1089 C99 P36991 oascsi.HttpClientUtil.createClient Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
[junit4:junit4]   2> 9319 T1089 C99 P36991 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 9323 T1051 C100 P45436 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 9324 T1051 C100 P45436 REQ /replication {command=indexversion&wt=javabin&qt=/replication&version=2} status=0 QTime=2 
[junit4:junit4]   2> 9325 T1089 C99 P36991 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 9325 T1089 C99 P36991 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 9326 T1089 C99 P36991 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 9329 T1049 C100 P45436 REQ /replication {command=filelist&generation=2&wt=javabin&qt=/replication&version=2} status=0 QTime=1 
[junit4:junit4]   2> 9330 T1089 C99 P36991 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 9331 T1089 C99 P36991 oash.SnapPuller.fetchLatestIndex Starting download to ./org.apache.solr.cloud.BasicDistributedZkTest-1355331647830/jetty3/index.20121212230057157 fullCopy=true
[junit4:junit4]   2> 9339 T1050 C100 P45436 REQ /replication {file=segments_2&command=filecontent&checksum=true&generation=2&qt=/replication&wt=filestream} status=0 QTime=2 
[junit4:junit4]   2> 9345 T1089 C99 P36991 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 9353 T1089 C99 P36991 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20121212230057157
[junit4:junit4]   2> 9355 T1089 C99 P36991 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.BasicDistributedZkTest-1355331647830/jetty3/index/ new=./org.apache.solr.cloud.BasicDistributedZkTest-1355331647830/jetty3/index.20121212230057157
[junit4:junit4]   2> 9356 T1089 C99 P36991 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355331647830/jetty3/index.20121212230057157 forceNew:false
[junit4:junit4]   2> 9359 T1089 C99 P36991 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355331647830/jetty3/index.20121212230057157 lockFactory=org.apache.lucene.store.NativeFSLockFactory@19d7012; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 9360 T1089 C99 P36991 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 9363 T1089 C99 P36991 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 9363 T1089 C99 P36991 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 9364 T1089 C99 P36991 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4]   2> 9365 T1089 C99 P36991 oasc.CachingDirectoryFactory.close Closing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355331647830/jetty3/index.20121212230057157
[junit4:junit4]   2> 9365 T1089 C99 P36991 oash.SnapPuller$2.onClose removing old index directory ./org.apache.solr.cloud.BasicDistributedZkTest-1355331647830/jetty3/index
[junit4:junit4]   2> 9367 T1089 C99 P36991 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355331647830/jetty3/index.20121212230057157 forceNew:true
[junit4:junit4]   2> 9370 T1089 C99 P36991 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355331647830/jetty3/index.20121212230057157 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3b6ec1; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 9370 T1089 C99 P36991 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 9371 T1089 C99 P36991 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 9372 T1089 C99 P36991 oass.SolrIndexSearcher.<init> Opening Searcher@9d90bd main
[junit4:junit4]   2> 9372 T1089 C99 P36991 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 9375 T1088 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@9d90bd main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 9375 T1089 C99 P36991 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 9405 T1089 C99 P36991 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355331647830/jetty3/index.20121212230057157 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3b6ec1; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355331647830/jetty3/index.20121212230057157 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3b6ec1; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 9406 T1089 C99 P36991 oasc.SolrDeletionPolicy.updateCommits newest commit = 3
[junit4:junit4]   2> 9407 T1089 C99 P36991 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 9407 T1089 C99 P36991 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 9408 T1089 C99 P36991 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 9408 T1089 C99 P36991 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 9408 T1089 C99 P36991 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 9410 T1089 C99 P36991 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 9433 T1017 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9769 T1040 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9770 T1040 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:36991_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:36991/solr"}
[junit4:junit4]   2> 9774 T1109 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9774 T1103 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9775 T1086 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9775 T1071 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9775 T1056 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9775 T1039 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2>  C101_STATE=coll:collection1 core:collection1 props:{shard=shard2, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:41314_solr, base_url=http://127.0.0.1:41314/solr}
[junit4:junit4]   2> 10418 T1106 C101 P41314 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 10418 T1106 C101 P41314 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 10418 T1106 C101 P41314 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:33310/solr/collection1/. core=collection1
[junit4:junit4]   2> 10419 T1106 C101 P41314 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 10424 T1066 C102 P33310 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 10426 T1066 C102 P33310 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355331647830/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1c4e7a5; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 10427 T1066 C102 P33310 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 10433 T1066 C102 P33310 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355331647830/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1c4e7a5; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355331647830/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1c4e7a5; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 10434 T1066 C102 P33310 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 10435 T1066 C102 P33310 oass.SolrIndexSearcher.<init> Opening Searcher@1268dd1 realtime
[junit4:junit4]   2> 10435 T1066 C102 P33310 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 10435 T1017 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10436 T1066 C102 P33310 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 10436 T1066 C102 P33310 /update {waitSearcher=true&openSearcher=false&commit=true&commit_end_point=true&wt=javabin&softCommit=false&version=2} {commit=} 0 13
[junit4:junit4]   2> 10437 T1106 C101 P41314 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 10438 T1106 C101 P41314 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 10440 T1064 C102 P33310 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 10441 T1064 C102 P33310 REQ /replication {command=indexversion&wt=javabin&qt=/replication&version=2} status=0 QTime=1 
[junit4:junit4]   2> 10441 T1106 C101 P41314 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 10442 T1106 C101 P41314 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 10442 T1106 C101 P41314 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 10444 T1066 C102 P33310 REQ /replication {command=filelist&generation=2&wt=javabin&qt=/replication&version=2} status=0 QTime=0 
[junit4:junit4]   2> 10444 T1106 C101 P41314 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 10445 T1106 C101 P41314 oash.SnapPuller.fetchLatestIndex Starting download to ./org.apache.solr.cloud.BasicDistributedZkTest-1355331647830/jetty4/index.20121212230058272 fullCopy=true
[junit4:junit4]   2> 10448 T1065 C102 P33310 REQ /replication {file=segments_2&command=filecontent&checksum=true&generation=2&qt=/replication&wt=filestream} status=0 QTime=1 
[junit4:junit4]   2> 10450 T1106 C101 P41314 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 10463 T1106 C101 P41314 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20121212230058272
[junit4:junit4]   2> 10464 T1106 C101 P41314 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.BasicDistributedZkTest-1355331647830/jetty4/index/ new=./org.apache.solr.cloud.BasicDistributedZkTest-1355331647830/jetty4/index.20121212230058272
[junit4:junit4]   2> 10465 T1106 C101 P41314 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355331647830/jetty4/index.20121212230058272 forceNew:false
[junit4:junit4]   2> 10466 T1106 C101 P41314 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355331647830/jetty4/index.20121212230058272 lockFactory=org.apache.lucene.store.NativeFSLockFactory@345b55; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 10466 T1106 C101 P41314 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 10467 T1106 C101 P41314 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 10467 T1106 C101 P41314 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 10467 T1106 C101 P41314 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4]   2> 10467 T1106 C101 P41314 oasc.CachingDirectoryFactory.close Closing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355331647830/jetty4/index.20121212230058272
[junit4:junit4]   2> 10468 T1106 C101 P41314 oash.SnapPuller$2.onClose removing old index directory ./org.apache.solr.cloud.BasicDistributedZkTest-1355331647830/jetty4/index
[junit4:junit4]   2> 10468 T1106 C101 P41314 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355331647830/jetty4/index.20121212230058272 forceNew:true
[junit4:junit4]   2> 10469 T1106 C101 P41314 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355331647830/jetty4/index.20121212230058272 lockFactory=org.apache.lucene.store.NativeFSLockFactory@b2201a; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 10470 T1106 C101 P41314 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 10470 T1106 C101 P41314 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 10470 T1106 C101 P41314 oass.SolrIndexSearcher.<init> Opening Searcher@1939560 main
[junit4:junit4]   2> 10470 T1106 C101 P41314 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 10472 T1105 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1939560 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 10472 T1106 C101 P41314 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 10505 T1106 C101 P41314 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355331647830/jetty4/index.20121212230058272 lockFactory=org.apache.lucene.store.NativeFSLockFactory@b2201a; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355331647830/jetty4/index.20121212230058272 lockFactory=org.apache.lucene.store.NativeFSLockFactory@b2201a; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 10506 T1106 C101 P41314 oasc.SolrDeletionPolicy.updateCommits newest commit = 3
[junit4:junit4]   2> 10507 T1106 C101 P41314 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 10507 T1106 C101 P41314 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 10508 T1106 C101 P41314 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 10508 T1106 C101 P41314 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 10508 T1106 C101 P41314 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 10510 T1106 C101 P41314 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 10780 T1040 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10781 T1040 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:41314_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:41314/solr"}
[junit4:junit4]   2> 10785 T1109 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10786 T1071 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10786 T1039 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10785 T1056 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10786 T1103 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10786 T1086 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 11438 T1017 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> ASYNC  NEW_CORE C103 name=collection1 org.apache.solr.core.SolrCore@1bcf1cd url=http://127.0.0.1:53224/solr/collection1 node=127.0.0.1:53224_solr
[junit4:junit4]   2> 11453 T1032 C103 P53224 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355331647830/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@d30363; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 11455 T1032 C103 P53224 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 11456 T1032 C103 P53224 oass.SolrIndexSearcher.<init> Opening Searcher@1e9d7c0 realtime
[junit4:junit4]   2> 11457 T1032 C103 P53224 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 11458 T1032 C103 P53224 /update {wt=javabin&version=2} {deleteByQuery=*:* (-1421168249958039552)} 0 9
[junit4:junit4]   2> 11459 T1017 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:35949/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1539e01
[junit4:junit4]   2> 11461 T1112 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:35949. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 11460 T1017 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 11461 T1112 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:35949, initiating session
[junit4:junit4]   2> 11461 T1019 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:53172
[junit4:junit4]   2> 11462 T1019 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:53172
[junit4:junit4]   2> 11463 T1021 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b900fb95a000d with negotiated timeout 10000 for client /127.0.0.1:53172
[junit4:junit4]   2> 11463 T1112 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:35949, sessionid = 0x13b900fb95a000d, negotiated timeout = 10000
[junit4:junit4]   2> 11464 T1113 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1539e01 name:ZooKeeperConnection Watcher:127.0.0.1:35949/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 11464 T1017 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 11466 T1017 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2>  C99_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:36991_solr, base_url=http://127.0.0.1:36991/solr}
[junit4:junit4]   2> 11482 T1081 C99 P36991 REQ /update {update.distrib=FROMLEADER&_version_=-1421168249981108224&update.from=http://127.0.0.1:45436/solr/collection1/&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2>  C101_STATE=coll:collection1 core:collection1 props:{shard=shard2, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:41314_solr, base_url=http://127.0.0.1:41314/solr}
[junit4:junit4]   2> 11485 T1098 C101 P41314 REQ /update {update.distrib=FROMLEADER&_version_=-1421168249984253952&update.from=http://127.0.0.1:33310/solr/collection1/&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11487 T1065 C102 P33310 REQ /update {update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=12 
[junit4:junit4]   2> 11488 T1050 C100 P45436 /update {wt=javabin&version=2} {deleteByQuery=*:* (-1421168249981108224)} 0 17
[junit4:junit4]   2> 11497 T1033 C103 P53224 /update {wt=javabin&version=2} {add=[1 (1421168250002079744)]} 0 5
[junit4:junit4]   2> 11512 T1082 C99 P36991 REQ /update {distrib.from=http://127.0.0.1:45436/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=5 
[junit4:junit4]   2> 11513 T1052 C100 P45436 /update {wt=javabin&version=2} {add=[1 (1421168250010468352)]} 0 13
[junit4:junit4]   2> 11519 T1034 C103 P53224 /update {wt=javabin&version=2} {add=[2 (1421168250027245568)]} 0 3
[junit4:junit4]   2> 11563 T1099 C101 P41314 REQ /update {distrib.from=http://127.0.0.1:33310/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=35 
[junit4:junit4]   2> 11565 T1064 C102 P33310 /update {wt=javabin&version=2} {add=[2 (1421168250033537024)]} 0 43
[junit4:junit4]   2> 11571 T1032 C103 P53224 /update {wt=javabin&version=2} {add=[3 (1421168250081771520)]} 0 3
[junit4:junit4]   2> 11578 T1097 C101 P41314 REQ /update {distrib.from=http://127.0.0.1:33310/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 11579 T1066 C102 P33310 /update {wt=javabin&version=2} {add=[3 (1421168250087014400)]} 0 6
[junit4:junit4]   2> 11583 T1033 C103 P53224 /update {wt=javabin&version=2} {add=[4 (1421168250096451584)]} 0 2
[junit4:junit4]   2> 11594 T1080 C99 P36991 REQ /update {distrib.from=http://127.0.0.1:45436/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=3 
[junit4:junit4]   2> 11594 T1051 C100 P45436 REQ /update {distrib.from=http://127.0.0.1:33310/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=7 
[junit4:junit4]   2> 11595 T1065 C102 P33310 /update {wt=javabin&version=2} {add=[4]} 0 10
[junit4:junit4]   2> 11599 T1034 C103 P53224 /update {wt=javabin&version=2} {add=[5 (1421168250113228800)]} 0 2
[junit4:junit4]   2> 11609 T1098 C101 P41314 REQ /update {distrib.from=http://127.0.0.1:33310/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 11610 T1067 C102 P33310 REQ /update {distrib.from=http://127.0.0.1:45436/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=7 
[junit4:junit4]   2> 11611 T1049 C100 P45436 /update {wt=javabin&version=2} {add=[5]} 0 10
[junit4:junit4]   2> 11614 T1035 C103 P53224 /update {wt=javabin&version=2} {add=[6 (1421168250128957440)]} 0 1
[junit4:junit4]   2> 11621 T1096 C101 P41314 REQ /update {distrib.from=http://127.0.0.1:33310/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11622 T1064 C102 P33310 /update {wt=javabin&version=2} {add=[6 (1421168250133151744)]} 0 5
[junit4:junit4]   2> 11626 T1032 C103 P53224 /update {wt=javabin&version=2} {add=[7 (1421168250140491776)]} 0 2
[junit4:junit4]   2> 11633 T1099 C101 P41314 REQ /update {distrib.from=http://127.0.0.1:33310/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11633 T1066 C102 P33310 /update {wt=javabin&version=2} {add=[7 (1421168250144686080)]} 0 5
[junit4:junit4]   2> 11638 T1033 C103 P53224 /update {wt=javabin&version=2} {add=[8 (1421168250153074688)]} 0 2
[junit4:junit4]   2> 11644 T1082 C99 P36991 REQ /update {distrib.from=http://127.0.0.1:45436/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11645 T1050 C100 P45436 /update {wt=javabin&version=2} {add=[8 (1421168250157268992)]} 0 5
[junit4:junit4]   2> 11649 T1034 C103 P53224 /update {wt=javabin&version=2} {add=[9 (1421168250164609024)]} 0 2
[junit4:junit4]   2> 11656 T1097 C101 P41314 REQ /update {distrib.from=http://127.0.0.1:33310/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11657 T1065 C102 P33310 /update {wt=javabin&version=2} {add=[9 (1421168250168803328)]} 0 6
[junit4:junit4]   2> 11672 T1035 C103 P53224 /update {wt=javabin&version=2} {add=[10 (1421168250178240512)]} 0 13
[junit4:junit4]   2> 11680 T1079 C99 P36991 REQ /update {distrib.from=http://127.0.0.1:45436/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 11681 T1052 C100 P45436 /update {wt=javabin&version=2} {add=[10 (1421168250193969152)]} 0 7
[junit4:junit4]   2> 11687 T1032 C103 P53224 /update {wt=javabin&version=2} {add=[11 (1421168250202357760)]} 0 4
[junit4:junit4]   2> 11698 T1081 C99 P36991 REQ /update {distrib.from=http://127.0.0.1:45436/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 11698 T1051 C100 P45436 REQ /update {distrib.from=http://127.0.0.1:33310/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=6 
[junit4:junit4]   2> 11699 T1067 C102 P33310 /update {wt=javabin&version=2} {add=[11]} 0 10
[junit4:junit4]   2> 11703 T1033 C103 P53224 /update {wt=javabin&version=2} {add=[12 (1421168250222280704)]} 0 1
[junit4:junit4]   2> 11710 T1080 C99 P36991 REQ /update {distrib.from=http://127.0.0.1:45436/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11711 T1049 C100 P45436 /update {wt=javabin&version=2} {add=[12 (1421168250226475008)]} 0 6
[junit4:junit4]   2> 11715 T1034 C103 P53224 /update {wt=javabin&version=2} {add=[13 (1421168250234863616)]} 0 1
[junit4:junit4]   2> 11724 T1082 C99 P36991 REQ /update {distrib.from=http://127.0.0.1:45436/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11725 T1050 C100 P45436 REQ /update {distrib.from=http://127.0.0.1:33310/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=6 
[junit4:junit4]   2> 11726 T1064 C102 P33310 /update {wt=javabin&version=2} {add=[13]} 0 9
[junit4:junit4]   2> 11730 T1035 C103 P53224 /update {wt=javabin&version=2} {add=[14 (1421168250249543680)]} 0 1
[junit4:junit4]   2> 11739 T1079 C99 P36991 REQ /update {distrib.from=http://127.0.0.1:45436/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 11740 T1052 C100 P45436 REQ /update {distrib.from=http://127.0.0.1:33310/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=6 
[junit4:junit4]   2> 11741 T1066 C102 P33310 /update {wt=javabin&version=2} {add=[14]} 0 9
[junit4:junit4]   2> 11745 T1032 C103 P53224 /update {wt=javabin&version=2} {add=[15 (1421168250266320896)]} 0 2
[junit4:junit4]   2> 11757 T1081 C99 P36991 REQ /update {distrib.from=http://127.0.0.1:45436/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 11757 T1051 C100 P45436 /update {wt=javabin&version=2} {add=[15 (1421168250270515200)]} 0 9
[junit4:junit4]   2> 11761 T1033 C103 P53224 /update {wt=javabin&version=2} {add=[16 (1421168250283098112)]} 0 1
[junit4:junit4]   2> 11788 T1080 C99 P36991 REQ /update {distrib.from=http://127.0.0.1:45436/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=11 
[junit4:junit4]   2> 11788 T1049 C100 P45436 /update {wt=javabin&version=2} {add=[16 (1421168250287292416)]} 0 24
[junit4:junit4]   2> 11794 T1034 C103 P53224 /update {wt=javabin&version=2} {add=[17 (1421168250316652544)]} 0 3
[junit4:junit4]   2> 11808 T1098 C101 P41314 REQ /update {distrib.from=http://127.0.0.1:33310/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=3 
[junit4:junit4]   2> 11808 T1065 C102 P33310 REQ /update {distrib.from=http://127.0.0.1:45436/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=8 
[junit4:junit4]   2> 11809 T1050 C100 P45436 /update {wt=javabin&version=2} {add=[17]} 0 12
[junit4:junit4]   2> 11812 T1035 C103 P53224 /update {wt=javabin&version=2} {add=[100 (1421168250336575488)]} 0 1
[junit4:junit4]   2> 11819 T1082 C99 P36991 REQ /update {distrib.from=http://127.0.0.1:45436/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11820 T1052 C100 P45436 /update {wt=javabin&version=2} {add=[100 (1421168250340769792)]} 0 6
[junit4:junit4]   2> 11824 T1032 C103 P53224 /update {wt=javabin&version=2} {add=[101 (1421168250349158400)]} 0 2
[junit4:junit4]   2> 11830 T1079 C99 P36991 REQ /update {distrib.from=http://127.0.0.1:45436/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11831 T1051 C100 P45436 /update {wt=javabin&version=2} {add=[101 (1421168250353352704)]} 0 5
[junit4:junit4]   2> 11844 T1033 C103 P53224 /update {wt=javabin&version=2} {add=[102 (1421168250360692736)]} 0 11
[junit4:junit4]   2> 11853 T1081 C99 P36991 REQ /update {distrib.from=http://127.0.0.1:45436/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 11853 T1049 C100 P45436 REQ /update {distrib.from=http://127.0.0.1:33310/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=5 
[junit4:junit4]   2> 11854 T1064 C102 P33310 /update {wt=javabin&version=2} {add=[102]} 0 8
[junit4:junit4]   2> 11859 T1035 C103 P53224 /update {wt=javabin&version=2} {add=[103 (1421168250384809984)]} 0 3
[junit4:junit4]   2> 11867 T1096 C101 P41314 REQ /update {distrib.from=http://127.0.0.1:33310/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 11868 T1066 C102 P33310 /update {wt=javabin&version=2} {add=[103 (1421168250390052864)]} 0 7
[junit4:junit4]   2> 11873 T1032 C103 P53224 /update {wt=javabin&version=2} {add=[104 (1421168250400538624)]} 0 2
[junit4:junit4]   2> 11883 T1099 C101 P41314 REQ /update {distrib.from=http://127.0.0.1:33310/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 11884 T1067 C102 P33310 REQ /update {distrib.from=http://127.0.0.1:45436/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=6 
[junit4:junit4]   2> 11884 T1052 C100 P45436 /update {wt=javabin&version=2} {add=[104]} 0 8
[junit4:junit4]   2> 11889 T1033 C103 P53224 /update {wt=javabin&version=2} {add=[105 (1421168250416267264)]} 0 2
[junit4:junit4]   2> 11922 T1098 C101 P41314 REQ /update {distrib.from=http://127.0.0.1:33310/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=16 
[junit4:junit4]   2> 11923 T1065 C102 P33310 /update {wt=javabin&version=2} {add=[105 (1421168250421510144)]} 0 32
[junit4:junit4]   2> 11927 T1034 C103 P53224 /update {wt=javabin&version=2} {add=[106 (1421168250457161728)]} 0 2
[junit4:junit4]   2> 11936 T1096 C101 P41314 REQ /update {distrib.from=http://127.0.0.1:33310/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 11937 T1066 C102 P33310 /update {wt=javabin&version=2} {add=[106 (1421168250461356032)]} 0 8
[junit4:junit4]   2> 11942 T1035 C103 P53224 /update {wt=javabin&version=2} {add=[107 (1421168250471841792)]} 0 2
[junit4:junit4]   2> 11950 T1080 C99 P36991 REQ /update {distrib.from=http://127.0.0.1:45436/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 11951 T1050 C100 P45436 /update {wt=javabin&version=2} {add=[107 (1421168250477084672)]} 0 6
[junit4:junit4]   2> 11955 T1032 C103 P53224 /update {wt=javabin&version=2} {add=[108 (1421168250486521856)]} 0 1
[junit4:junit4]   2> 11965 T1079 C99 P36991 REQ /update {distrib.from=http://127.0.0.1:45436/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 11966 T1049 C100 P45436 REQ /update {distrib.from=http://127.0.0.1:33310/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=6 
[junit4:junit4]   2> 11966 T1067 C102 P33310 /update {wt=javabin&version=2} {add=[108]} 0 8
[junit4:junit4]   2> 11970 T1034 C103 P53224 /update {wt=javabin&version=2} {add=[109 (1421168250502250496)]} 0 1
[junit4:junit4]   2> 11979 T1081 C99 P36991 REQ /update {distrib.from=http://127.0.0.1:45436/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11980 T1051 C100 P45436 REQ /update {distrib.from=http://127.0.0.1:33310/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=6 
[junit4:junit4]   2> 11981 T1065 C102 P33310 /update {wt=javabin&version=2} {add=[109]} 0 9
[junit4:junit4]   2> 11984 T1035 C103 P53224 /update {wt=javabin&version=2} {add=[110 (1421168250516930560)]} 0 1
[junit4:junit4]   2> 11994 T1080 C99 P36991 REQ /update {distrib.from=http://127.0.0.1:45436/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 11995 T1052 C100 P45436 REQ /update {distrib.from=http://127.0.0.1:33310/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=6 
[junit4:junit4]   2> 11996 T1064 C102 P33310 /update {wt=javabin&version=2} {add=[110]} 0 9
[junit4:junit4]   2> 12001 T1032 C103 P53224 /update {wt=javabin&version=2} {add=[111 (1421168250532659200)]} 0 3
[junit4:junit4]   2> 12008 T1079 C99 P36991 REQ /update {distrib.from=http://127.0.0.1:45436/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 12009 T1050 C100 P45436 /update {wt=javabin&version=2} {add=[111 (1421168250538950656)]} 0 5
[junit4:junit4]   2> 12024 T1033 C103 P53224 /update {wt=javabin&version=2} {add=[112 (1421168250547339264)]} 0 11
[junit4:junit4]   2> 12033 T1099 C101 P41314 REQ /update {distrib.from=http://127.0.0.1:33310/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 12034 T1066 C102 P33310 REQ /update {distrib.from=http://127.0.0.1:45436/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=5 
[junit4:junit4]   2> 12035 T1049 C100 P45436 /update {wt=javabin&version=2} {add=[112]} 0 9
[junit4:junit4]   2> 12039 T1034 C103 P53224 /update {wt=javabin&version=2} {add=[113 (1421168250573553664)]} 0 2
[junit4:junit4]   2> 12048 T1081 C99 P36991 REQ /update {distrib.from=http://127.0.0.1:45436/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 12048 T1051 C100 P45436 REQ /update {distrib.from=http://127.0.0.1:33310/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=5 
[junit4:junit4]   2> 12049 T1067 C102 P33310 /update {wt=javabin&version=2} {add=[113]} 0 8
[junit4:junit4]   2> 12052 T1035 C103 P53224 /update {wt=javabin&version=2} {add=[114 (1421168250589282304)]} 0 1
[junit4:junit4]   2> 12079 T1082 C99 P36991 REQ /update {distrib.from=http://127.0.0.1:45436/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=12 
[junit4:junit4]   2> 12080 T1052 C100 P45436 REQ /update {distrib.from=http://127.0.0.1:33310/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=23 
[junit4:junit4]   2> 12080 T1065 C102 P33310 /update {wt=javabin&version=2} {add=[114]} 0 25
[junit4:junit4]   2> 12084 T1032 C103 P53224 /update {wt=javabin&version=2} {add=[115 (1421168250621788160)]} 0 1
[junit4:junit4]   2> 12094 T1098 C101 P41314 REQ /update {distrib.from=http://127.0.0.1:33310/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 12095 T1064 C102 P33310 REQ /update {distrib.from=http://127.0.0.1:45436/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=7 
[junit4:junit4]   2> 12095 T1050 C100 P45436 /update {wt=javabin&version=2} {

[...truncated too long message...]

           "node_name":"127.0.0.1:57152_solr",
[junit4:junit4]   1>                 "base_url":"http://127.0.0.1:57152/solr",
[junit4:junit4]   1>                 "leader":"true"}}}}}
[junit4:junit4]   1>  /zookeeper (1)
[junit4:junit4]   1>  DATA:
[junit4:junit4]   1>      
[junit4:junit4]   1> 
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=BasicDistributedZk2Test -Dtests.method=testDistribSearch -Dtests.seed=9276FF091583F295 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=fi -Dtests.timezone=Pacific/Nauru -Dtests.file.encoding=UTF-8
[junit4:junit4] FAILURE  565s J0 | BasicDistributedZk2Test.testDistribSearch <<<
[junit4:junit4]    > Throwable #1: java.lang.AssertionError: There are still nodes recoverying - waited for 540 seconds
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([9276FF091583F295:1390711162DC92A9]:0)
[junit4:junit4]    > 	at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:165)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:115)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:110)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:563)
[junit4:junit4]    > 	at org.apache.solr.cloud.BasicDistributedZk2Test.brindDownShardIndexSomeDocsAndRecover(BasicDistributedZk2Test.java:321)
[junit4:junit4]    > 	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:83)
[junit4:junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:601)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 565412 T2293 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> NOTE: test params are: codec=Lucene40, sim=DefaultSimilarity, locale=fi, timezone=Pacific/Nauru
[junit4:junit4]   2> NOTE: Linux 3.2.0-34-generic i386/Oracle Corporation 1.7.0_09 (32-bit)/cpus=8,threads=1,free=83908328,total=518979584
[junit4:junit4]   2> NOTE: All tests run in this JVM: [DistanceFunctionTest, CoreAdminHandlerTest, TestDefaultSimilarityFactory, TestLFUCache, DateFieldTest, TermsComponentTest, SolrPluginUtilsTest, AlternateDirectoryTest, TestWordDelimiterFilterFactory, TestPHPSerializedResponseWriter, TestAtomicUpdateErrorCases, TestCollationField, TestStressVersions, TestPseudoReturnFields, WordBreakSolrSpellCheckerTest, TestGroupingSearch, TestCoreContainer, SpellCheckCollatorTest, TestQuerySenderNoQuery, SolrCmdDistributorTest, StatelessScriptUpdateProcessorFactoryTest, TestIBSimilarityFactory, TestSearchPerf, AnalysisAfterCoreReloadTest, MinimalSchemaTest, JSONWriterTest, NoCacheHeaderTest, TestFiltering, TestSolrQueryParser, SearchHandlerTest, SpatialFilterTest, BadComponentTest, SampleTest, DistributedTermsComponentTest, CopyFieldTest, TestNumberUtils, NumericFieldsTest, TestLMJelinekMercerSimilarityFactory, TestIndexSearcher, TestJmxMonitoredMap, TestSystemIdResolver, LeaderElectionIntegrationTest, CSVRequestHandlerTest, ResourceLoaderTest, SuggesterWFSTTest, RequestHandlersTest, QueryElevationComponentTest, TestIndexingPerformance, TestXIncludeConfig, TestReload, TermVectorComponentDistributedTest, PreAnalyzedFieldTest, JsonLoaderTest, DefaultValueUpdateProcessorTest, BasicDistributedZkTest, TestExtendedDismaxParser, AutoCommitTest, ZkSolrClientTest, TestFaceting, TestRecovery, TestJoin, TestArbitraryIndexDir, UniqFieldsUpdateProcessorFactoryTest, BadIndexSchemaTest, TestLuceneMatchVersion, UpdateRequestProcessorFactoryTest, FieldMutatingUpdateProcessorTest, TestSolrDeletionPolicy2, TestMergePolicyConfig, OutputWriterTest, TestSolrCoreProperties, EchoParamsTest, TestLMDirichletSimilarityFactory, TestDFRSimilarityFactory, DateMathParserTest, PrimUtilsTest, TestSolrXMLSerializer, TestBadConfig, TestCollationKeyRangeQueries, BasicDistributedZk2Test]
[junit4:junit4] Completed on J0 in 565.43s, 1 test, 1 failure <<< FAILURES!

[...truncated 11 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:352: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:178: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:438: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1175: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:839: There were test failures: 239 suites, 994 tests, 1 error, 1 failure, 7 ignored (2 assumptions)

Total time: 34 minutes 19 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 32bit/jdk1.7.0_09 -server -XX:+UseSerialGC
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-4.x-Linux (32bit/jdk1.8.0-ea-b65) - Build # 3185 - Still Failing!

Posted by Policeman Jenkins Server <je...@sd-datasolutions.de>.
Build: http://jenkins.sd-datasolutions.de/job/Lucene-Solr-4.x-Linux/3185/
Java: 32bit/jdk1.8.0-ea-b65 -client -XX:+UseG1GC

3 tests failed.
FAILED:  org.apache.solr.cloud.SyncSliceTest.testDistribSearch

Error Message:
There are still nodes recoverying - waited for 540 seconds

Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 540 seconds
	at __randomizedtesting.SeedInfo.seed([A08AAC0EF28723FC:216C221685D843C0]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:165)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:115)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:110)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:563)
	at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:224)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:474)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)


FAILED:  org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch

Error Message:
There are still nodes recoverying - waited for 540 seconds

Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 540 seconds
	at __randomizedtesting.SeedInfo.seed([A08AAC0EF28723FC:216C221685D843C0]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:165)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:115)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:110)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:563)
	at org.apache.solr.cloud.BasicDistributedZk2Test.brindDownShardIndexSomeDocsAndRecover(BasicDistributedZk2Test.java:321)
	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:83)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:474)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)


FAILED:  org.apache.solr.cloud.BasicDistributedZkTest.testDistribSearch

Error Message:
Server at http://127.0.0.1:34554/solr returned non ok status:500, message:Server Error

Stack Trace:
org.apache.solr.common.SolrException: Server at http://127.0.0.1:34554/solr returned non ok status:500, message:Server Error
	at __randomizedtesting.SeedInfo.seed([A08AAC0EF28723FC:216C221685D843C0]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:374)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
	at org.apache.solr.client.solrj.request.CoreAdminRequest.process(CoreAdminRequest.java:429)
	at org.apache.solr.client.solrj.request.CoreAdminRequest.getStatus(CoreAdminRequest.java:472)
	at org.apache.solr.cloud.BasicDistributedZkTest.collectStartTimes(BasicDistributedZkTest.java:959)
	at org.apache.solr.cloud.BasicDistributedZkTest.testCollectionsAPI(BasicDistributedZkTest.java:795)
	at org.apache.solr.cloud.BasicDistributedZkTest.doTest(BasicDistributedZkTest.java:343)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:474)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)




Build Log:
[...truncated 8671 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZkTest
[junit4:junit4]   2> 2 T322 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZkTest-1355327705731
[junit4:junit4]   2> 5 T322 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 7 T323 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 26 T323 oaz.Environment.logEnv Server environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
[junit4:junit4]   2> 26 T323 oaz.Environment.logEnv Server environment:host.name=serv1
[junit4:junit4]   2> 26 T323 oaz.Environment.logEnv Server environment:java.version=1.8.0-ea
[junit4:junit4]   2> 26 T323 oaz.Environment.logEnv Server environment:java.vendor=Oracle Corporation
[junit4:junit4]   2> 27 T323 oaz.Environment.logEnv Server environment:java.home=/mnt/ssd/jenkins/tools/java/32bit/jdk1.8.0-ea-b65/jre
[junit4:junit4]   2> 27 T323 oaz.Environment.logEnv Server environment:java.class.path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/test:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/codecs/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-solrj/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/common/lucene-analyzers-common-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/highlighter/lucene-highlighter-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/memory/lucene-memory-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/misc/lucene-misc-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/spatial/lucene-spatial-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/suggest/lucene-suggest-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/grouping/lucene-grouping-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queries/lucene-queries-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queryparser/lucene-queryparser-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/cglib-nodep-2.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-cli-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-codec-1.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-fileupload-1.2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-lang-2.6.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/easymock-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/guava-13.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/javax.servlet-api-3.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/metrics-core-2.1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/objenesis-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/spatial4j-0.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/commons-io-2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpclient-4.1.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpcore-4.1.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpmime-4.1.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/jcl-over-slf4j-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/log4j-over-slf4j-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-api-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-jdk14-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/wstx-asl-3.2.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/zookeeper-3.4.5.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-continuation-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-deploy-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-http-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-io-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-jmx-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-security-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-server-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-servlet-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-util-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-webapp-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-xml-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/servlet-api-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/hsqldb-1.8.0.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/junit-4.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/randomizedtesting-runner-2.0.5.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-launcher.jar:/var/lib/jenkins/.ant/lib/ivy-2.2.0.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jdepend.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-netrexx.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-antlr.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-commons-net.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-javamail.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-regexp.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jsch.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-xalan2.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-junit4.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jmf.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-junit.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-bcel.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jai.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-commons-logging.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-resolver.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-oro.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-swing.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-bsf.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-log4j.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-testutil.jar:/mnt/ssd/jenkins/tools/java/32bit/jdk1.8.0-ea-b65/lib/tools.jar:/var/lib/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.0.5.jar
[junit4:junit4]   2> 28 T323 oaz.Environment.logEnv Server environment:java.library.path=/usr/lib/jvm/j2sdk1.6-sun/jre/lib/amd64/server:/usr/lib/jvm/j2sdk1.6-sun/jre/lib/amd64:/usr/lib/jvm/j2sdk1.6-sun/jre/../lib/amd64:/usr/java/packages/lib/i386:/lib:/usr/lib
[junit4:junit4]   2> 28 T323 oaz.Environment.logEnv Server environment:java.io.tmpdir=.
[junit4:junit4]   2> 28 T323 oaz.Environment.logEnv Server environment:java.compiler=<NA>
[junit4:junit4]   2> 28 T323 oaz.Environment.logEnv Server environment:os.name=Linux
[junit4:junit4]   2> 28 T323 oaz.Environment.logEnv Server environment:os.arch=i386
[junit4:junit4]   2> 28 T323 oaz.Environment.logEnv Server environment:os.version=3.2.0-34-generic
[junit4:junit4]   2> 28 T323 oaz.Environment.logEnv Server environment:user.name=jenkins
[junit4:junit4]   2> 28 T323 oaz.Environment.logEnv Server environment:user.home=/var/lib/jenkins
[junit4:junit4]   2> 29 T323 oaz.Environment.logEnv Server environment:user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 40 T323 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 40 T323 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4]   2> 40 T323 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4]   2> 42 T323 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 66 T323 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355327705731/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4]   2> 107 T322 oasc.ZkTestServer.run start zk server on port:44827
[junit4:junit4]   2> 135 T322 oaz.Environment.logEnv Client environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
[junit4:junit4]   2> 135 T322 oaz.Environment.logEnv Client environment:host.name=serv1
[junit4:junit4]   2> 136 T322 oaz.Environment.logEnv Client environment:java.version=1.8.0-ea
[junit4:junit4]   2> 136 T322 oaz.Environment.logEnv Client environment:java.vendor=Oracle Corporation
[junit4:junit4]   2> 137 T322 oaz.Environment.logEnv Client environment:java.home=/mnt/ssd/jenkins/tools/java/32bit/jdk1.8.0-ea-b65/jre
[junit4:junit4]   2> 137 T322 oaz.Environment.logEnv Client environment:java.class.path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/test:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/codecs/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-solrj/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/common/lucene-analyzers-common-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/highlighter/lucene-highlighter-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/memory/lucene-memory-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/misc/lucene-misc-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/spatial/lucene-spatial-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/suggest/lucene-suggest-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/grouping/lucene-grouping-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queries/lucene-queries-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queryparser/lucene-queryparser-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/cglib-nodep-2.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-cli-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-codec-1.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-fileupload-1.2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-lang-2.6.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/easymock-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/guava-13.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/javax.servlet-api-3.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/metrics-core-2.1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/objenesis-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/spatial4j-0.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/commons-io-2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpclient-4.1.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpcore-4.1.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpmime-4.1.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/jcl-over-slf4j-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/log4j-over-slf4j-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-api-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-jdk14-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/wstx-asl-3.2.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/zookeeper-3.4.5.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-continuation-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-deploy-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-http-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-io-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-jmx-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-security-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-server-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-servlet-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-util-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-webapp-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-xml-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/servlet-api-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/hsqldb-1.8.0.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/junit-4.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/randomizedtesting-runner-2.0.5.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-launcher.jar:/var/lib/jenkins/.ant/lib/ivy-2.2.0.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jdepend.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-netrexx.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-antlr.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-commons-net.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-javamail.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-regexp.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jsch.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-xalan2.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-junit4.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jmf.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-junit.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-bcel.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jai.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-commons-logging.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-resolver.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-oro.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-swing.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-bsf.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-log4j.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-testutil.jar:/mnt/ssd/jenkins/tools/java/32bit/jdk1.8.0-ea-b65/lib/tools.jar:/var/lib/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.0.5.jar
[junit4:junit4]   2> 140 T322 oaz.Environment.logEnv Client environment:java.library.path=/usr/lib/jvm/j2sdk1.6-sun/jre/lib/amd64/server:/usr/lib/jvm/j2sdk1.6-sun/jre/lib/amd64:/usr/lib/jvm/j2sdk1.6-sun/jre/../lib/amd64:/usr/java/packages/lib/i386:/lib:/usr/lib
[junit4:junit4]   2> 141 T322 oaz.Environment.logEnv Client environment:java.io.tmpdir=.
[junit4:junit4]   2> 141 T322 oaz.Environment.logEnv Client environment:java.compiler=<NA>
[junit4:junit4]   2> 142 T322 oaz.Environment.logEnv Client environment:os.name=Linux
[junit4:junit4]   2> 143 T322 oaz.Environment.logEnv Client environment:os.arch=i386
[junit4:junit4]   2> 143 T322 oaz.Environment.logEnv Client environment:os.version=3.2.0-34-generic
[junit4:junit4]   2> 144 T322 oaz.Environment.logEnv Client environment:user.name=jenkins
[junit4:junit4]   2> 145 T322 oaz.Environment.logEnv Client environment:user.home=/var/lib/jenkins
[junit4:junit4]   2> 145 T322 oaz.Environment.logEnv Client environment:user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 149 T322 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:44827 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@7a6027
[junit4:junit4]   2> 173 T322 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 179 T328 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:44827. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 181 T328 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:44827, initiating session
[junit4:junit4]   2> 181 T324 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:41574
[junit4:junit4]   2> 191 T324 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:41574
[junit4:junit4]   2> 197 T326 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 228 T326 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8fd392cb0000 with negotiated timeout 10000 for client /127.0.0.1:41574
[junit4:junit4]   2> 228 T328 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:44827, sessionid = 0x13b8fd392cb0000, negotiated timeout = 10000
[junit4:junit4]   2> 234 T329 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7a6027 name:ZooKeeperConnection Watcher:127.0.0.1:44827 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 235 T322 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 238 T322 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 274 T327 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8fd392cb0000
[junit4:junit4]   2> 275 T329 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 275 T322 oaz.ZooKeeper.close Session: 0x13b8fd392cb0000 closed
[junit4:junit4]   2> 276 T322 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:44827/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1c62ae4
[junit4:junit4]   2> 277 T324 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:41574 which had sessionid 0x13b8fd392cb0000
[junit4:junit4]   2> 278 T322 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 278 T330 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:44827. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 279 T330 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:44827, initiating session
[junit4:junit4]   2> 279 T324 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:41575
[junit4:junit4]   2> 279 T324 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:41575
[junit4:junit4]   2> 280 T326 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8fd392cb0001 with negotiated timeout 10000 for client /127.0.0.1:41575
[junit4:junit4]   2> 280 T330 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:44827, sessionid = 0x13b8fd392cb0001, negotiated timeout = 10000
[junit4:junit4]   2> 281 T331 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c62ae4 name:ZooKeeperConnection Watcher:127.0.0.1:44827/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 281 T322 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 285 T322 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 289 T322 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 293 T322 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 295 T322 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 299 T322 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 300 T322 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 306 T322 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 306 T322 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 310 T322 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 311 T322 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 317 T322 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 318 T322 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 321 T322 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 322 T322 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 324 T322 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 325 T322 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 328 T322 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 328 T322 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 331 T322 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 331 T322 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 334 T322 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 335 T322 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 338 T322 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 339 T322 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 342 T327 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8fd392cb0001
[junit4:junit4]   2> 343 T331 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 343 T322 oaz.ZooKeeper.close Session: 0x13b8fd392cb0001 closed
[junit4:junit4]   2> 343 T324 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:41575 which had sessionid 0x13b8fd392cb0001
[junit4:junit4]   2> 404 T322 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 406 T322 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:42848
[junit4:junit4]   2> 407 T322 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 407 T322 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355327706071
[junit4:junit4]   2> 407 T322 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355327706071/'
[junit4:junit4]   2> 421 T322 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 421 T322 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 421 T322 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355327706071
[junit4:junit4]   2> 422 T322 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355327706071/solr.xml
[junit4:junit4]   2> 422 T322 oasc.CoreContainer.<init> New CoreContainer 26407394
[junit4:junit4]   2> 423 T322 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355327706071/'
[junit4:junit4]   2> 423 T322 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355327706071/'
[junit4:junit4]   2> 446 T322 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 457 T322 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:44827/solr
[junit4:junit4]   2> 465 T322 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 465 T322 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:44827 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@3babc7
[junit4:junit4]   2> 466 T322 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 466 T341 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:44827. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 467 T341 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:44827, initiating session
[junit4:junit4]   2> 467 T324 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:41576
[junit4:junit4]   2> 467 T324 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:41576
[junit4:junit4]   2> 469 T326 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8fd392cb0002 with negotiated timeout 20000 for client /127.0.0.1:41576
[junit4:junit4]   2> 469 T341 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:44827, sessionid = 0x13b8fd392cb0002, negotiated timeout = 20000
[junit4:junit4]   2> 469 T342 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3babc7 name:ZooKeeperConnection Watcher:127.0.0.1:44827 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 469 T322 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 471 T327 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8fd392cb0002
[junit4:junit4]   2> 472 T324 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:41576 which had sessionid 0x13b8fd392cb0002
[junit4:junit4]   2> 472 T342 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 472 T322 oaz.ZooKeeper.close Session: 0x13b8fd392cb0002 closed
[junit4:junit4]   2> 473 T322 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:44827/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@3754e9
[junit4:junit4]   2> 474 T322 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 475 T343 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:44827. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 475 T343 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:44827, initiating session
[junit4:junit4]   2> 475 T324 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:41577
[junit4:junit4]   2> 476 T324 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:41577
[junit4:junit4]   2> 476 T326 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8fd392cb0003 with negotiated timeout 8000 for client /127.0.0.1:41577
[junit4:junit4]   2> 476 T343 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:44827, sessionid = 0x13b8fd392cb0003, negotiated timeout = 8000
[junit4:junit4]   2> 477 T344 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3754e9 name:ZooKeeperConnection Watcher:127.0.0.1:44827/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 477 T322 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 485 T327 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8fd392cb0003 type:create cxid:0x2 zxid:0x1b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 489 T322 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 491 T322 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42848_solr
[junit4:junit4]   2> 493 T327 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8fd392cb0003 type:delete cxid:0x7 zxid:0x1d txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:42848_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:42848_solr
[junit4:junit4]   2> 496 T322 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:42848_solr
[junit4:junit4]   2> 498 T322 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 499 T322 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 499 T322 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 499 T322 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 500 T322 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 500 T322 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 500 T322 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 501 T322 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 501 T322 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 501 T322 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 505 T322 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 516 T327 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8fd392cb0003 type:delete cxid:0x15 zxid:0x22 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 517 T322 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 520 T322 oasc.Overseer.start Overseer (id=88822756527505411-127.0.0.1:42848_solr-n_0000000000) starting
[junit4:junit4]   2> 520 T327 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8fd392cb0003 type:create cxid:0x1a zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 525 T327 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8fd392cb0003 type:create cxid:0x1b zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 526 T327 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8fd392cb0003 type:create cxid:0x1c zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 529 T327 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8fd392cb0003 type:create cxid:0x1d zxid:0x27 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 530 T346 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
[junit4:junit4]   2> 531 T322 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 533 T322 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 543 T345 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 552 T347 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355327706071/collection1
[junit4:junit4]   2> 552 T347 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4]   2> 553 T347 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 553 T347 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4]   2> 555 T347 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355327706071/collection1/'
[junit4:junit4]   2> 556 T347 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355327706071/collection1/lib/README' to classloader
[junit4:junit4]   2> 556 T347 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355327706071/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 591 T347 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 644 T347 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 645 T347 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 649 T347 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 1099 T347 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 1106 T347 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 1109 T347 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 1122 T347 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1143 T347 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1147 T347 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1148 T347 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1149 T347 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355327706071/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355327705731/control/data/
[junit4:junit4]   2> 1151 T347 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1227bc5
[junit4:junit4]   2> 1151 T347 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355327705731/control/data/index/
[junit4:junit4]   2> 1152 T347 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355327705731/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 1152 T347 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355327705731/control/data/index forceNew:false
[junit4:junit4]   2> 1156 T347 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355327705731/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@16d9ace; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 1156 T347 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 1157 T347 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 1158 T347 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 1158 T347 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 1158 T347 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 1158 T347 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 1159 T347 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 1159 T347 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 1159 T347 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 1160 T347 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 1160 T347 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 1161 T347 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 1162 T347 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 1162 T347 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 1162 T347 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 1163 T347 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 1163 T347 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 1163 T347 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 1164 T347 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1165 T347 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1165 T347 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1166 T347 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1166 T347 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1167 T347 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1168 T347 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1169 T347 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 1170 T347 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 1172 T347 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 1174 T347 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 1175 T347 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [STOPWORDS.TXT, SCHEMA.XML, OLD_SYNONYMS.TXT, OPEN-EXCHANGE-RATES.JSON, PROTWORDS.TXT, SYNONYMS.TXT, MAPPING-ISOLATIN1ACCENT.TXT, CURRENCY.XML]
[junit4:junit4]   2> 1177 T347 oass.SolrIndexSearcher.<init> Opening Searcher@629a98 main
[junit4:junit4]   2> 1178 T347 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 1186 T347 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 1187 T347 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 1187 T347 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 1190 T347 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 1213 T348 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@629a98 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 1217 T347 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 1217 T347 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 1218 T327 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8fd392cb0003 type:create cxid:0x53 zxid:0x2a txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 1221 T347 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 1221 T347 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:42848/solr shardId:control_shard
[junit4:junit4]   2> 1225 T347 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4]   2> 1229 T347 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/control_shard/election
[junit4:junit4]   2> 1236 T327 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8fd392cb0003 type:delete cxid:0x62 zxid:0x31 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4]   2> 1236 T347 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 1237 T327 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8fd392cb0003 type:create cxid:0x63 zxid:0x32 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1551 T345 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 1553 T345 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:42848/solr",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:42848_solr",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "shard":"control_shard",
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1"}
[junit4:junit4]   2> 1558 T327 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8fd392cb0003 type:create cxid:0x6a zxid:0x34 txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 1570 T344 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 1739 T347 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 1740 T347 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 1740 T347 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:42848/solr/collection1/
[junit4:junit4]   2> 1740 T347 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 1741 T347 oasc.SyncStrategy.syncToMe http://127.0.0.1:42848/solr/collection1/ has no replicas
[junit4:junit4]   2> 1741 T347 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:42848/solr/collection1/
[junit4:junit4]   2> 1741 T347 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/control_shard
[junit4:junit4]   2> 1746 T327 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8fd392cb0003 type:create cxid:0x89 zxid:0x3f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2077 T345 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2082 T344 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 2099 T347 oasc.ZkController.register We are http://127.0.0.1:42848/solr/collection1/ and leader is http://127.0.0.1:42848/solr/collection1/
[junit4:junit4]   2> 2100 T347 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:42848/solr
[junit4:junit4]   2> 2100 T347 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 2100 T347 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 2101 T347 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 2102 T347 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2103 T322 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 2104 T322 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 2104 T322 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 2164 T322 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 2166 T322 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:40244
[junit4:junit4]   2> 2167 T322 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 2168 T322 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355327707835
[junit4:junit4]   2> 2168 T322 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355327707835/'
[junit4:junit4]   2> 2191 T322 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 2192 T322 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 2193 T322 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355327707835
[junit4:junit4]   2> 2194 T322 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355327707835/solr.xml
[junit4:junit4]   2> 2194 T322 oasc.CoreContainer.<init> New CoreContainer 12061925
[junit4:junit4]   2> 2195 T322 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355327707835/'
[junit4:junit4]   2> 2196 T322 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355327707835/'
[junit4:junit4]   2> 2213 T322 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 2224 T322 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:44827/solr
[junit4:junit4]   2> 2224 T322 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 2225 T322 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:44827 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@d29a7a
[junit4:junit4]   2> 2225 T322 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2226 T358 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:44827. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 2226 T358 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:44827, initiating session
[junit4:junit4]   2> 2226 T324 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:41578
[junit4:junit4]   2> 2227 T324 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:41578
[junit4:junit4]   2> 2228 T326 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8fd392cb0004 with negotiated timeout 20000 for client /127.0.0.1:41578
[junit4:junit4]   2> 2228 T358 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:44827, sessionid = 0x13b8fd392cb0004, negotiated timeout = 20000
[junit4:junit4]   2> 2228 T359 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d29a7a name:ZooKeeperConnection Watcher:127.0.0.1:44827 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2228 T322 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2230 T327 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8fd392cb0004
[junit4:junit4]   2> 2230 T324 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:41578 which had sessionid 0x13b8fd392cb0004
[junit4:junit4]   2> 2230 T322 oaz.ZooKeeper.close Session: 0x13b8fd392cb0004 closed
[junit4:junit4]   2> 2230 T359 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 2231 T322 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:44827/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@d182d9
[junit4:junit4]   2> 2232 T322 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2232 T360 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:44827. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 2232 T360 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:44827, initiating session
[junit4:junit4]   2> 2232 T324 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:41579
[junit4:junit4]   2> 2233 T324 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:41579
[junit4:junit4]   2> 2233 T326 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8fd392cb0005 with negotiated timeout 8000 for client /127.0.0.1:41579
[junit4:junit4]   2> 2233 T360 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:44827, sessionid = 0x13b8fd392cb0005, negotiated timeout = 8000
[junit4:junit4]   2> 2234 T361 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d182d9 name:ZooKeeperConnection Watcher:127.0.0.1:44827/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2234 T322 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2235 T327 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8fd392cb0005 type:create cxid:0x1 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2236 T327 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8fd392cb0005 type:create cxid:0x2 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2237 T322 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40244_solr
[junit4:junit4]   2> 2238 T327 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8fd392cb0005 type:delete cxid:0x4 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:40244_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:40244_solr
[junit4:junit4]   2> 2238 T322 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:40244_solr
[junit4:junit4]   2> 2241 T344 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 2241 T344 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 2241 T322 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 2242 T322 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 2242 T322 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 2243 T322 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 2243 T322 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 2243 T322 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 2244 T322 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 2244 T322 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 2245 T322 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 2245 T322 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 2274 T322 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 2280 T362 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355327707835/collection1
[junit4:junit4]   2> 2280 T362 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 2281 T362 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 2281 T362 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 2282 T362 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355327707835/collection1/'
[junit4:junit4]   2> 2283 T362 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty1-1355327707835/collection1/lib/README' to classloader
[junit4:junit4]   2> 2283 T362 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty1-1355327707835/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 2314 T362 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 2368 T362 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 2369 T362 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 2374 T362 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 2589 T345 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2590 T345 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:42848/solr",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:42848_solr",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "shard":"control_shard",
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1"}
[junit4:junit4]   2> 2594 T361 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 2594 T344 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 2853 T362 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 2859 T362 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 2861 T362 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 2881 T362 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 2889 T362 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 2898 T362 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 2900 T362 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 2903 T362 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355327707835/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355327705731/jetty1/
[junit4:junit4]   2> 2903 T362 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1227bc5
[junit4:junit4]   2> 2904 T362 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355327705731/jetty1/index/
[junit4:junit4]   2> 2905 T362 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355327705731/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 2906 T362 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355327705731/jetty1/index forceNew:false
[junit4:junit4]   2> 2911 T362 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355327705731/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@f8c64f; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 2911 T362 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 2912 T362 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 2915 T362 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 2915 T362 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 2915 T362 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 2916 T362 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 2917 T362 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 2917 T362 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 2918 T362 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 2919 T362 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 2920 T362 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 2920 T362 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 2921 T362 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 2921 T362 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 2922 T362 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 2922 T362 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 2922 T362 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 2923 T362 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 2924 T362 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2924 T362 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2925 T362 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2926 T362 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2927 T362 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2927 T362 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2928 T362 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2929 T362 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 2929 T362 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 2932 T362 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 2933 T362 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 2935 T362 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [STOPWORDS.TXT, SCHEMA.XML, OLD_SYNONYMS.TXT, OPEN-EXCHANGE-RATES.JSON, PROTWORDS.TXT, SYNONYMS.TXT, MAPPING-ISOLATIN1ACCENT.TXT, CURRENCY.XML]
[junit4:junit4]   2> 2937 T362 oass.SolrIndexSearcher.<init> Opening Searcher@1363e3 main
[junit4:junit4]   2> 2937 T362 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 2938 T362 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 2938 T362 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 2938 T362 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 2941 T362 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 2964 T363 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1363e3 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 2979 T362 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 2979 T362 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 3099 T345 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3100 T345 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:40244/solr",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:40244_solr",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1"}
[junit4:junit4]   2> 3100 T345 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4]   2> 3102 T345 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 3107 T344 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3107 T361 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3482 T362 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 3482 T362 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:40244/solr shardId:shard1
[junit4:junit4]   2> 3483 T362 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 3489 T327 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8fd392cb0005 type:delete cxid:0x45 zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 3490 T362 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 3490 T327 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8fd392cb0005 type:create cxid:0x46 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3492 T362 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 3492 T362 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 3493 T362 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:40244/solr/collection1/
[junit4:junit4]   2> 3493 T362 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 3493 T362 oasc.SyncStrategy.syncToMe http://127.0.0.1:40244/solr/collection1/ has no replicas
[junit4:junit4]   2> 3493 T362 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:40244/solr/collection1/
[junit4:junit4]   2> 3493 T362 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 3497 T327 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8fd392cb0005 type:create cxid:0x50 zxid:0x60 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3614 T345 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3631 T344 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3631 T361 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3649 T362 oasc.ZkController.register We are http://127.0.0.1:40244/solr/collection1/ and leader is http://127.0.0.1:40244/solr/collection1/
[junit4:junit4]   2> 3650 T362 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:40244/solr
[junit4:junit4]   2> 3650 T362 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 3651 T362 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 3651 T362 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 3654 T362 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3656 T322 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 3657 T322 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 3658 T322 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 3729 T322 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 3731 T322 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:34554
[junit4:junit4]   2> 3732 T322 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 3733 T322 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355327709395
[junit4:junit4]   2> 3733 T322 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355327709395/'
[junit4:junit4]   2> 3746 T322 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 3746 T322 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 3747 T322 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355327709395
[junit4:junit4]   2> 3747 T322 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355327709395/solr.xml
[junit4:junit4]   2> 3747 T322 oasc.CoreContainer.<init> New CoreContainer 28039911
[junit4:junit4]   2> 3748 T322 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355327709395/'
[junit4:junit4]   2> 3748 T322 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355327709395/'
[junit4:junit4]   2> 3762 T322 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 3772 T322 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:44827/solr
[junit4:junit4]   2> 3773 T322 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 3773 T322 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:44827 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@9e2e78
[junit4:junit4]   2> 3774 T322 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3774 T373 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:44827. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 3775 T373 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:44827, initiating session
[junit4:junit4]   2> 3775 T324 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:41580
[junit4:junit4]   2> 3775 T324 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:41580
[junit4:junit4]   2> 3776 T326 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8fd392cb0006 with negotiated timeout 20000 for client /127.0.0.1:41580
[junit4:junit4]   2> 3776 T373 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:44827, sessionid = 0x13b8fd392cb0006, negotiated timeout = 20000
[junit4:junit4]   2> 3777 T374 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@9e2e78 name:ZooKeeperConnection Watcher:127.0.0.1:44827 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3777 T322 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3778 T327 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8fd392cb0006
[junit4:junit4]   2> 3779 T324 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:41580 which had sessionid 0x13b8fd392cb0006
[junit4:junit4]   2> 3779 T374 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 3779 T322 oaz.ZooKeeper.close Session: 0x13b8fd392cb0006 closed
[junit4:junit4]   2> 3780 T322 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:44827/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@16da65f
[junit4:junit4]   2> 3781 T375 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:44827. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 3781 T322 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3781 T324 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:41581
[junit4:junit4]   2> 3781 T375 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:44827, initiating session
[junit4:junit4]   2> 3782 T324 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:41581
[junit4:junit4]   2> 3782 T326 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8fd392cb0007 with negotiated timeout 8000 for client /127.0.0.1:41581
[junit4:junit4]   2> 3782 T375 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:44827, sessionid = 0x13b8fd392cb0007, negotiated timeout = 8000
[junit4:junit4]   2> 3783 T376 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@16da65f name:ZooKeeperConnection Watcher:127.0.0.1:44827/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3783 T322 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3784 T327 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8fd392cb0007 type:create cxid:0x1 zxid:0x6d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3785 T327 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8fd392cb0007 type:create cxid:0x2 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3786 T322 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34554_solr
[junit4:junit4]   2> 3787 T327 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8fd392cb0007 type:delete cxid:0x4 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:34554_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:34554_solr
[junit4:junit4]   2> 3787 T322 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:34554_solr
[junit4:junit4]   2> 3790 T344 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 3790 T361 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 3790 T344 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 3790 T361 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 3791 T322 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 3791 T322 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 3792 T322 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 3792 T322 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 3792 T322 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 3793 T322 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 3793 T322 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 3794 T322 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 3794 T322 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 3794 T322 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 3800 T322 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3806 T377 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355327709395/collection1
[junit4:junit4]   2> 3806 T377 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 3807 T377 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 3807 T377 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 3808 T377 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355327709395/collection1/'
[junit4:junit4]   2> 3809 T377 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty2-1355327709395/collection1/lib/README' to classloader
[junit4:junit4]   2> 3809 T377 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty2-1355327709395/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 3845 T377 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 3901 T377 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 3903 T377 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 3907 T377 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 4141 T345 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4141 T345 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:40244/solr",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:40244_solr",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1"}
[junit4:junit4]   2> 4145 T344 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4145 T376 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4146 T361 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4326 T377 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 4332 T377 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 4335 T377 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 4349 T377 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 4353 T377 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 4356 T377 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 4358 T377 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 4359 T377 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355327709395/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355327705731/jetty2/
[junit4:junit4]   2> 4360 T377 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1227bc5
[junit4:junit4]   2> 4360 T377 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355327705731/jetty2/index/
[junit4:junit4]   2> 4361 T377 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355327705731/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 4362 T377 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355327705731/jetty2/index forceNew:false
[junit4:junit4]   2> 4367 T377 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355327705731/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@16db53a; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 4368 T377 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 4368 T377 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 4371 T377 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 4371 T377 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 4371 T377 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 4372 T377 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 4373 T377 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 4373 T377 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 4374 T377 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 4375 T377 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 4377 T377 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 4378 T377 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 4379 T377 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 4379 T377 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 4380 T377 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 4380 T377 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 4380 T377 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 4381 T377 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 4381 T377 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4382 T377 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4383 T377 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4383 T377 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4384 T377 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4385 T377 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4385 T377 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4386 T377 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 4387 T377 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 4389 T377 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 4391 T377 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 4393 T377 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [STOPWORDS.TXT, SCHEMA.XML, OLD_SYNONYMS.TXT, OPEN-EXCHANGE-RATES.JSON, PROTWORDS.TXT, SYNONYMS.TXT, MAPPING-ISOLATIN1ACCENT.TXT, CURRENCY.XML]
[junit4:junit4]   2> 4396 T377 oass.SolrIndexSearcher.<init> Opening Searcher@1dc0066 main
[junit4:junit4]   2> 4396 T377 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 4397 T377 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 4397 T377 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 4398 T377 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 4401 T377 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 4436 T378 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1dc0066 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 4446 T377 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 4446 T377 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 4651 T345 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4652 T345 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:34554/solr",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:34554_solr",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1"}
[junit4:junit4]   2> 4652 T345 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 4652 T345 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4]   2> 4756 T361 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4756 T376 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4756 T344 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4948 T377 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 4948 T377 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:34554/solr shardId:shard2
[junit4:junit4]   2> 4949 T377 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4]   2> 4955 T327 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8fd392cb0007 type:delete cxid:0x44 zxid:0x7e txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard2 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard2
[junit4:junit4]   2> 4956 T377 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 4956 T327 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8fd392cb0007 type:create cxid:0x45 zxid:0x7f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4958 T377 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 4958 T377 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 4958 T377 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:34554/solr/collection1/
[junit4:junit4]   2> 4959 T377 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 4959 T377 oasc.SyncStrategy.syncToMe http://127.0.0.1:34554/solr/collection1/ has no replicas
[junit4:junit4]   2> 4959 T377 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:34554/solr/collection1/
[junit4:junit4]   2> 4959 T377 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4]   2> 4962 T327 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8fd392cb0007 type:create cxid:0x4e zxid:0x82 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5263 T345 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5271 T344 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5271 T361 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5271 T376 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5315 T377 oasc.ZkController.register We are http://127.0.0.1:34554/solr/collection1/ and leader is http://127.0.0.1:34554/solr/collection1/
[junit4:junit4]   2> 5316 T377 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:34554/solr
[junit4:junit4]   2> 5316 T377 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 5316 T377 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 5316 T377 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 5318 T377 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5319 T322 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 5319 T322 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 5320 T322 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 5381 T322 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 5383 T322 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:50073
[junit4:junit4]   2> 5384 T322 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 5384 T322 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355327711051
[junit4:junit4]   2> 5384 T322 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355327711051/'
[junit4:junit4]   2> 5397 T322 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 5398 T322 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 5398 T322 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355327711051
[junit4:junit4]   2> 5399 T322 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355327711051/solr.xml
[junit4:junit4]   2> 5399 T322 oasc.CoreContainer.<init> New CoreContainer 18276485
[junit4:junit4]   2> 5399 T322 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355327711051/'
[junit4:junit4]   2> 5400 T322 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355327711051/'
[junit4:junit4]   2> 5423 T322 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 5434 T322 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:44827/solr
[junit4:junit4]   2> 5434 T322 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 5434 T322 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:44827 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@135f53d
[junit4:junit4]   2> 5435 T322 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 5436 T388 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:44827. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 5436 T388 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:44827, initiating session
[junit4:junit4]   2> 5436 T324 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:41582
[junit4:junit4]   2> 5437 T324 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:41582
[junit4:junit4]   2> 5437 T326 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8fd392cb0008 with negotiated timeout 20000 for client /127.0.0.1:41582
[junit4:junit4]   2> 5437 T388 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:44827, sessionid = 0x13b8fd392cb0008, negotiated timeout = 20000
[junit4:junit4]   2> 5438 T389 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@135f53d name:ZooKeeperConnection Watcher:127.0.0.1:44827 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 5438 T322 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 5439 T327 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8fd392cb0008
[junit4:junit4]   2> 5440 T324 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:41582 which had sessionid 0x13b8fd392cb0008
[junit4:junit4]   2> 5440 T389 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 5440 T322 oaz.ZooKeeper.close Session: 0x13b8fd392cb0008 closed
[junit4:junit4]   2> 5441 T322 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:44827/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@1ad229b
[junit4:junit4]   2> 5442 T390 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:44827. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 5442 T322 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 5442 T390 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:44827, initiating session
[junit4:junit4]   2> 5442 T324 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:41583
[junit4:junit4]   2> 5443 T324 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:41583
[junit4:junit4]   2> 5443 T326 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8fd392cb0009 with negotiated timeout 8000 for client /127.0.0.1:41583
[junit4:junit4]   2> 5443 T390 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:44827, sessionid = 0x13b8fd392cb0009, negotiated timeout = 8000
[junit4:junit4]   2> 5444 T391 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ad229b name:ZooKeeperConnection Watcher:127.0.0.1:44827/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 5444 T322 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 5445 T327 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8fd392cb0009 type:create cxid:0x1 zxid:0x8f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5446 T327 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8fd392cb0009 type:create cxid:0x2 zxid:0x90 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5447 T322 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50073_solr
[junit4:junit4]   2> 5447 T327 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8fd392cb0009 type:delete cxid:0x4 zxid:0x91 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:50073_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:50073_solr
[junit4:junit4]   2> 5448 T322 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50073_solr
[junit4:junit4]   2> 5450 T376 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5451 T344 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 5451 T361 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 5451 T344 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5451 T361 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5451 T322 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 5452 T376 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 5452 T322 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 5452 T322 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 5453 T322 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 5453 T322 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 5453 T322 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 5454 T322 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 5454 T322 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 5454 T322 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 5455 T322 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 5461 T322 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 5468 T392 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355327711051/collection1
[junit4:junit4]   2> 5468 T392 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 5469 T392 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 5469 T392 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 5470 T392 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355327711051/collection1/'
[junit4:junit4]   2> 5470 T392 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty3-1355327711051/collection1/lib/README' to classloader
[junit4:junit4]   2> 5471 T392 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty3-1355327711051/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 5503 T392 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 5560 T392 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 5561 T392 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 5565 T392 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 5776 T345 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5777 T345 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:34554/solr",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:34554_solr",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1"}
[junit4:junit4]   2> 5781 T361 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5781 T376 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5781 T344 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5781 T391 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6009 T392 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 6015 T392 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 6018 T392 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 6030 T392 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 6033 T392 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 6038 T392 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 6045 T392 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 6047 T392 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355327711051/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355327705731/jetty3/
[junit4:junit4]   2> 6047 T392 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1227bc5
[junit4:junit4]   2> 6048 T392 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355327705731/jetty3/index/
[junit4:junit4]   2> 6048 T392 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355327705731/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 6049 T392 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355327705731/jetty3/index forceNew:false
[junit4:junit4]   2> 6128 T392 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355327705731/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1abd096; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 6128 T392 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 6128 T392 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 6130 T392 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 6130 T392 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 6130 T392 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 6130 T392 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 6131 T392 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 6131 T392 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 6131 T392 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 6132 T392 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 6133 T392 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 6133 T392 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 6134 T392 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 6135 T392 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 6135 T392 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 6135 T392 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 6136 T392 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 6137 T392 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 6137 T392 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6138 T392 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6139 T392 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6139 T392 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6140 T392 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6141 T392 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6141 T392 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6142 T392 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 6143 T392 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 6145 T392 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 6147 T392 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 6148 T392 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [STOPWORDS.TXT, SCHEMA.XML, OLD_SYNONYMS.TXT, OPEN-EXCHANGE-RATES.JSON, PROTWORDS.TXT, SYNONYMS.TXT, MAPPING-ISOLATIN1ACCENT.TXT, CURRENCY.XML]
[junit4:junit4]   2> 6150 T392 oass.SolrIndexSearcher.<init> Opening Searcher@28e2f1 main
[junit4:junit4]   2> 6151 T392 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 6151 T392 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 6151 T392 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 6152 T392 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 6155 T392 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 6178 T393 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@28e2f1 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 6191 T392 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 6191 T392 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 6286 T345 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6287 T345 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:50073/solr",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:50073_solr",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1"}
[junit4:junit4]   2> 6288 T345 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 6288 T345 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 6299 T376 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6299 T361 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6299 T344 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6299 T391 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6693 T392 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 6693 T392 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:50073/solr shardId:shard1
[junit4:junit4]   2> 6699 T392 oasc.ZkController.register We are http://127.0.0.1:50073/solr/collection1/ and leader is http://127.0.0.1:40244/solr/collection1/
[junit4:junit4]   2> 6699 T392 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:50073/solr
[junit4:junit4]   2> 6699 T392 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 6700 T392 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C24 name=collection1 org.apache.solr.core.SolrCore@10cd13f url=http://127.0.0.1:50073/solr/collection1 node=127.0.0.1:50073_solr
[junit4:junit4]   2> 6705 T394 C24 P50073 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 6706 T392 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6707 T394 C24 P50073 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 6707 T394 C24 P50073 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 6708 T394 C24 P50073 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 6709 T322 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 6710 T394 C24 P50073 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:40244/solr/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 6710 T322 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 6711 T322 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 6716 T394 C24 P50073 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4]   2> 6723 T394 C24 P50073 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:50073/solr START replicas=[http://127.0.0.1:40244/solr/collection1/] nUpdates=100
[junit4:junit4]   2> 6723 T394 C24 P50073 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 6724 T394 C24 P50073 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 6724 T394 C24 P50073 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 6724 T394 C24 P50073 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C25 name=collection1 org.apache.solr.core.SolrCore@f3a603 url=http://127.0.0.1:40244/solr/collection1 node=127.0.0.1:40244_solr
[junit4:junit4]   2> 6729 T356 C25 P40244 REQ /get {qt=/get&getVersions=100&distrib=false&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 6801 T322 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 6805 T345 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6805 T322 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:60485
[junit4:junit4]   2> 6805 T322 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 6806 T345 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:50073/solr",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:50073_solr",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1"}
[junit4:junit4]   2> 6806 T322 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355327712446
[junit4:junit4]   2> 6807 T322 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355327712446/'
[junit4:junit4]   2> 6809 T391 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6809 T376 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6810 T361 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6810 T344 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6825 T322 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 6825 T322 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 6826 T322 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355327712446
[junit4:junit4]   2> 6827 T322 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355327712446/solr.xml
[junit4:junit4]   2> 6827 T322 oasc.CoreContainer.<init> New CoreContainer 28273754
[junit4:junit4]   2> 6828 T322 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355327712446/'
[junit4:junit4]   2> 6828 T322 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355327712446/'
[junit4:junit4]   2> 6845 T322 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 6858 T322 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:44827/solr
[junit4:junit4]   2> 6858 T322 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 6859 T322 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:44827 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@e4e95a
[junit4:junit4]   2> 6860 T405 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:44827. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 6860 T322 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6861 T405 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:44827, initiating session
[junit4:junit4]   2> 6861 T324 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:41586
[junit4:junit4]   2> 6861 T324 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:41586
[junit4:junit4]   2> 6862 T326 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8fd392cb000a with negotiated timeout 20000 for client /127.0.0.1:41586
[junit4:junit4]   2> 6862 T405 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:44827, sessionid = 0x13b8fd392cb000a, negotiated timeout = 20000
[junit4:junit4]   2> 6863 T406 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e4e95a name:ZooKeeperConnection Watcher:127.0.0.1:44827 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6863 T322 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6864 T327 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8fd392cb000a
[junit4:junit4]   2> 6865 T406 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 6865 T324 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:41586 which had sessionid 0x13b8fd392cb000a
[junit4:junit4]   2> 6865 T322 oaz.ZooKeeper.close Session: 0x13b8fd392cb000a closed
[junit4:junit4]   2> 6866 T322 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:44827/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@168de97
[junit4:junit4]   2> 6867 T322 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6867 T407 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:44827. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 6867 T407 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:44827, initiating session
[junit4:junit4]   2> 6868 T324 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:41587
[junit4:junit4]   2> 6868 T324 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:41587
[junit4:junit4]   2> 6870 T326 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8fd392cb000b with negotiated timeout 8000 for client /127.0.0.1:41587
[junit4:junit4]   2> 6870 T407 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:44827, sessionid = 0x13b8fd392cb000b, negotiated timeout = 8000
[junit4:junit4]   2> 6870 T408 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@168de97 name:ZooKeeperConnection Watcher:127.0.0.1:44827/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6871 T322 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6872 T327 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8fd392cb000b type:create cxid:0x1 zxid:0xa6 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6873 T327 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8fd392cb000b type:create cxid:0x2 zxid:0xa7 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6874 T322 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60485_solr
[junit4:junit4]   2> 6874 T327 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8fd392cb000b type:delete cxid:0x4 zxid:0xa8 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:60485_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:60485_solr
[junit4:junit4]   2> 6875 T322 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:60485_solr
[junit4:junit4]   2> 6877 T391 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6877 T376 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6877 T344 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6877 T361 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 6878 T361 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6878 T391 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 6879 T376 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 6879 T344 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 6879 T322 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 6880 T322 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 6880 T322 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 6881 T322 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 6882 T322 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 6883 T322 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 6883 T322 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 6884 T322 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 6885 T322 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 6886 T322 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 6898 T322 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 6909 T409 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355327712446/collection1
[junit4:junit4]   2> 6910 T409 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 6911 T409 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 6912 T409 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 6914 T409 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355327712446/collection1/'
[junit4:junit4]   2> 6915 T409 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty4-1355327712446/collection1/lib/README' to classloader
[junit4:junit4]   2> 6916 T409 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty4-1355327712446/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 6998 T409 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 7045 T409 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 7046 T409 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 7051 T409 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 7513 T409 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 7519 T409 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 7522 T409 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 7536 T409 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 7540 T409 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 7544 T409 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 7545 T409 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 7546 T409 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355327712446/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355327705731/jetty4/
[junit4:junit4]   2> 7547 T409 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1227bc5
[junit4:junit4]   2> 7547 T409 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355327705731/jetty4/index/
[junit4:junit4]   2> 7547 T409 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355327705731/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 7548 T409 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355327705731/jetty4/index forceNew:false
[junit4:junit4]   2> 7568 T409 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355327705731/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@f6b220; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 7568 T409 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 7569 T409 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 7570 T409 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 7570 T409 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 7570 T409 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 7571 T409 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 7571 T409 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 7571 T409 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 7572 T409 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 7572 T409 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 7573 T409 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 7574 T409 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 7574 T409 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 7575 T409 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 7575 T409 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 7576 T409 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 7576 T409 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 7576 T409 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 7577 T409 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7578 T409 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7578 T409 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7579 T409 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7580 T409 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7581 T409 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7581 T409 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7582 T409 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 7583 T409 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 7585 T409 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 7587 T409 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 7588 T409 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [STOPWORDS.TXT, SCHEMA.XML, OLD_SYNONYMS.TXT, OPEN-EXCHANGE-RATES.JSON, PROTWORDS.TXT, SYNONYMS.TXT, MAPPING-ISOLATIN1ACCENT.TXT, CURRENCY.XML]
[junit4:junit4]   2> 7590 T409 oass.SolrIndexSearcher.<init> Opening Searcher@176cd2d main
[junit4:junit4]   2> 7591 T409 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 7591 T409 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 7591 T409 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 7592 T409 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 7595 T409 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 7619 T410 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@176cd2d main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 7626 T409 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 7627 T409 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 7817 T345 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7818 T345 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:60485/solr",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:60485_solr",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1"}
[junit4:junit4]   2> 7818 T345 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 7819 T345 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4]   2> 7825 T408 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7825 T361 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7825 T376 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7825 T391 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7825 T344 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8128 T409 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 8129 T409 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:60485/solr shardId:shard2
[junit4:junit4]   2> 8133 T409 oasc.ZkController.register We are http://127.0.0.1:60485/solr/collection1/ and leader is http://127.0.0.1:34554/solr/collection1/
[junit4:junit4]   2> 8133 T409 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:60485/solr
[junit4:junit4]   2> 8133 T409 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 8133 T409 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C26 name=collection1 org.apache.solr.core.SolrCore@1bcc78 url=http://127.0.0.1:60485/solr/collection1 node=127.0.0.1:60485_solr
[junit4:junit4]   2> 8134 T411 C26 P60485 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 8134 T411 C26 P60485 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 8134 T409 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8135 T411 C26 P60485 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 8135 T411 C26 P60485 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 8136 T411 C26 P60485 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:34554/solr/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 8136 T322 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 8136 T411 C26 P60485 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:60485/solr START replicas=[http://127.0.0.1:34554/solr/collection1/] nUpdates=100
[junit4:junit4]   2> 8137 T322 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 8137 T411 C26 P60485 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 8138 T411 C26 P60485 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 8137 T322 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 8138 T411 C26 P60485 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 8139 T411 C26 P60485 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 8144 T322 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:44827/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@16ae1da
[junit4:junit4]   2> ASYNC  NEW_CORE C27 name=collection1 org.apache.solr.core.SolrCore@176dced url=http://127.0.0.1:34554/solr/collection1 node=127.0.0.1:34554_solr
[junit4:junit4]   2> 8145 T369 C27 P34554 REQ /get {qt=/get&getVersions=100&distrib=false&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 8146 T413 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:44827. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 8146 T322 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 8146 T413 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:44827, initiating session
[junit4:junit4]   2> 8146 T324 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:41590
[junit4:junit4]   2> 8147 T324 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:41590
[junit4:junit4]   2> 8147 T326 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8fd392cb000c with negotiated timeout 10000 for client /127.0.0.1:41590
[junit4:junit4]   2> 8147 T413 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:44827, sessionid = 0x13b8fd392cb000c, negotiated timeout = 10000
[junit4:junit4]   2> 8148 T414 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@16ae1da name:ZooKeeperConnection Watcher:127.0.0.1:44827/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 8148 T322 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 8149 T322 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 8153 T322 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 8154 T322 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 8158 T322 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8160 T322 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):540
[junit4:junit4]   2> 8161 T322 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8332 T345 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8333 T345 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:60485/solr",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:60485_solr",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1"}
[junit4:junit4]   2> 8395 T344 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8395 T391 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8395 T408 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8395 T361 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8396 T414 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8396 T376 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9163 T322 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2>  C24_STATE=coll:collection1 core:collection1 props:{collection=collection1, base_url=http://127.0.0.1:50073/solr, node_name=127.0.0.1:50073_solr, roles=null, shard=shard1, state=recovering, core=collection1}
[junit4:junit4]   2> 9730 T394 C24 P50073 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 9731 T394 C24 P50073 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 9732 T394 C24 P50073 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:40244/solr/collection1/. core=collection1
[junit4:junit4]   2> 9732 T394 C24 P50073 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 9742 T356 C25 P40244 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16
[junit4:junit4]   2> 9764 T356 C25 P40244 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 9768 T356 C25 P40244 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355327705731/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@f8c64f; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 9769 T356 C25 P40244 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 9896 T356 C25 P40244 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355327705731/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@f8c64f; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355327705731/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@f8c64f; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 9897 T356 C25 P40244 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 9897 T356 C25 P40244 oass.SolrIndexSearcher.<init> Opening Searcher@f17431 realtime
[junit4:junit4]   2> 9897 T356 C25 P40244 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 9898 T356 C25 P40244 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 9898 T356 C25 P40244 /update {commit=true&openSearcher=false&version=2&softCommit=false&waitSearcher=true&commit_end_point=true&wt=javabin} {commit=} 0 159
[junit4:junit4]   2> 9914 T394 C24 P50073 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 9915 T394 C24 P50073 oascsi.HttpClientUtil.createClient Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
[junit4:junit4]   2> 9920 T394 C24 P50073 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 9922 T357 C25 P40244 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 9923 T357 C25 P40244 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 9923 T394 C24 P50073 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 9924 T394 C24 P50073 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 9924 T394 C24 P50073 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 9926 T356 C25 P40244 REQ /replication {command=filelist&qt=/replication&generation=2&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 9926 T394 C24 P50073 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 9927 T394 C24 P50073 oash.SnapPuller.fetchLatestIndex Starting download to ./org.apache.solr.cloud.BasicDistributedZkTest-1355327705731/jetty3/index.20121212105515655 fullCopy=true
[junit4:junit4]   2> 9942 T354 C25 P40244 REQ /replication {command=filecontent&file=segments_2&qt=/replication&checksum=true&generation=2&wt=filestream} status=0 QTime=2 
[junit4:junit4]   2> 9948 T394 C24 P50073 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 9956 T394 C24 P50073 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20121212105515655
[junit4:junit4]   2> 9957 T394 C24 P50073 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.BasicDistributedZkTest-1355327705731/jetty3/index/ new=./org.apache.solr.cloud.BasicDistributedZkTest-1355327705731/jetty3/index.20121212105515655
[junit4:junit4]   2> 9957 T394 C24 P50073 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355327705731/jetty3/index.20121212105515655 forceNew:false
[junit4:junit4]   2> 9959 T394 C24 P50073 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355327705731/jetty3/index.20121212105515655 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7a5b2d; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 9960 T394 C24 P50073 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 9961 T394 C24 P50073 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 9961 T394 C24 P50073 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 9962 T394 C24 P50073 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4]   2> 9962 T394 C24 P50073 oasc.CachingDirectoryFactory.close Closing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355327705731/jetty3/index.20121212105515655
[junit4:junit4]   2> 9962 T394 C24 P50073 oash.SnapPuller$2.onClose removing old index directory ./org.apache.solr.cloud.BasicDistributedZkTest-1355327705731/jetty3/index
[junit4:junit4]   2> 9963 T394 C24 P50073 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355327705731/jetty3/index.20121212105515655 forceNew:true
[junit4:junit4]   2> 9965 T394 C24 P50073 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355327705731/jetty3/index.20121212105515655 lockFactory=org.apache.lucene.store.NativeFSLockFactory@15ae357; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 9965 T394 C24 P50073 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 9965 T394 C24 P50073 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 9966 T394 C24 P50073 oass.SolrIndexSearcher.<init> Opening Searcher@3b8150 main
[junit4:junit4]   2> 9966 T394 C24 P50073 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 9968 T393 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3b8150 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 9969 T394 C24 P50073 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 9990 T394 C24 P50073 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355327705731/jetty3/index.20121212105515655 lockFactory=org.apache.lucene.store.NativeFSLockFactory@15ae357; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355327705731/jetty3/index.20121212105515655 lockFactory=org.apache.lucene.store.NativeFSLockFactory@15ae357; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 9991 T394 C24 P50073 oasc.SolrDeletionPolicy.updateCommits newest commit = 3
[junit4:junit4]   2> 9991 T394 C24 P50073 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 9992 T394 C24 P50073 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 9992 T394 C24 P50073 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 9992 T394 C24 P50073 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 9992 T394 C24 P50073 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 9993 T394 C24 P50073 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 10165 T322 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10405 T345 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10405 T345 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:50073/solr",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:50073_solr",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1"}
[junit4:junit4]   2> 10416 T344 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10416 T376 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10416 T408 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10416 T414 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10416 T361 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10416 T391 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2>  C26_STATE=coll:collection1 core:collection1 props:{collection=collection1, base_url=http://127.0.0.1:60485/solr, node_name=127.0.0.1:60485_solr, roles=null, shard=shard2, state=recovering, core=collection1}
[junit4:junit4]   2> 11145 T411 C26 P60485 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 11145 T411 C26 P60485 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 11146 T411 C26 P60485 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:34554/solr/collection1/. core=collection1
[junit4:junit4]   2> 11146 T411 C26 P60485 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 11150 T371 C27 P34554 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 11153 T371 C27 P34554 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355327705731/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@16db53a; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 11153 T371 C27 P34554 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 11166 T371 C27 P34554 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355327705731/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@16db53a; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355327705731/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@16db53a; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 11166 T322 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 11167 T371 C27 P34554 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 11168 T371 C27 P34554 oass.SolrIndexSearcher.<init> Opening Searcher@14d765e realtime
[junit4:junit4]   2> 11168 T371 C27 P34554 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 11168 T371 C27 P34554 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 11168 T371 C27 P34554 /update {commit=true&openSearcher=false&version=2&softCommit=false&waitSearcher=true&commit_end_point=true&wt=javabin} {commit=} 0 18
[junit4:junit4]   2> 11170 T411 C26 P60485 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 11170 T411 C26 P60485 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 11172 T372 C27 P34554 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 11173 T372 C27 P34554 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 11173 T411 C26 P60485 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 11174 T411 C26 P60485 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 11174 T411 C26 P60485 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 11176 T369 C27 P34554 REQ /replication {command=filelist&qt=/replication&generation=2&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11176 T411 C26 P60485 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 11177 T411 C26 P60485 oash.SnapPuller.fetchLatestIndex Starting download to ./org.apache.solr.cloud.BasicDistributedZkTest-1355327705731/jetty4/index.20121212105516904 fullCopy=true
[junit4:junit4]   2> 11195 T371 C27 P34554 REQ /replication {command=filecontent&file=segments_2&qt=/replication&checksum=true&generation=2&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 11198 T411 C26 P60485 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 11206 T411 C26 P60485 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20121212105516904
[junit4:junit4]   2> 11207 T411 C26 P60485 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.BasicDistributedZkTest-1355327705731/jetty4/index/ new=./org.apache.solr.cloud.BasicDistributedZkTest-1355327705731/jetty4/index.20121212105516904
[junit4:junit4]   2> 11208 T411 C26 P60485 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355327705731/jetty4/index.20121212105516904 forceNew:false
[junit4:junit4]   2> 11209 T411 C26 P60485 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355327705731/jetty4/index.20121212105516904 lockFactory=org.apache.lucene.store.NativeFSLockFactory@dbe4f3; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 11210 T411 C26 P60485 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 11211 T411 C26 P60485 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 11211 T411 C26 P60485 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 11212 T411 C26 P60485 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4]   2> 11212 T411 C26 P60485 oasc.CachingDirectoryFactory.close Closing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355327705731/jetty4/index.20121212105516904
[junit4:junit4]   2> 11213 T411 C26 P60485 oash.SnapPuller$2.onClose removing old index directory ./org.apache.solr.cloud.BasicDistributedZkTest-1355327705731/jetty4/index
[junit4:junit4]   2> 11214 T411 C26 P60485 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355327705731/jetty4/index.20121212105516904 forceNew:true
[junit4:junit4]   2> 11216 T411 C26 P60485 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355327705731/jetty4/index.20121212105516904 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1b3f63d; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 11216 T411 C26 P60485 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 11216 T411 C26 P60485 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 11217 T411 C26 P60485 oass.SolrIndexSearcher.<init> Opening Searcher@283a70 main
[junit4:junit4]   2> 11217 T411 C26 P60485 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 11220 T410 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@283a70 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 11220 T411 C26 P60485 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 11248 T411 C26 P60485 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355327705731/jetty4/index.20121212105516904 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1b3f63d; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355327705731/jetty4/index.20121212105516904 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1b3f63d; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 11248 T411 C26 P60485 oasc.SolrDeletionPolicy.updateCommits newest commit = 3
[junit4:junit4]   2> 11249 T411 C26 P60485 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 11249 T411 C26 P60485 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 11249 T411 C26 P60485 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 11249 T411 C26 P60485 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 11249 T411 C26 P60485 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 11251 T411 C26 P60485 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 11424 T345 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 11425 T345 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "base_url":"http:

[...truncated too long message...]

ts.slow=true -Dtests.locale=en_US -Dtests.timezone=Europe/San_Marino -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] FAILURE  585s J0 | SyncSliceTest.testDistribSearch <<<
[junit4:junit4]    > Throwable #1: java.lang.AssertionError: There are still nodes recoverying - waited for 540 seconds
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([A08AAC0EF28723FC:216C221685D843C0]:0)
[junit4:junit4]    > 	at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:165)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:115)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:110)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:563)
[junit4:junit4]    > 	at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:224)
[junit4:junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:474)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 584821 T2281 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> NOTE: test params are: codec=Asserting, sim=DefaultSimilarity, locale=en_US, timezone=Europe/San_Marino
[junit4:junit4]   2> NOTE: Linux 3.2.0-34-generic i386/Oracle Corporation 1.8.0-ea (32-bit)/cpus=8,threads=2,free=142625192,total=348127232
[junit4:junit4]   2> NOTE: All tests run in this JVM: [CacheHeaderTest, TestAnalyzedSuggestions, TestRTGBase, TestCollationField, FieldAnalysisRequestHandlerTest, CoreContainerCoreInitFailuresTest, TestCoreContainer, TermVectorComponentDistributedTest, TestLFUCache, TestSearchPerf, NotRequiredUniqueKeyTest, TestXIncludeConfig, TestCharFilters, CoreAdminHandlerTest, TestPseudoReturnFields, DistributedSpellCheckComponentTest, TestQueryTypes, BasicDistributedZkTest, TestPHPSerializedResponseWriter, DistributedTermsComponentTest, TestBadConfig, TestSuggestSpellingConverter, TestStressVersions, TestIndexingPerformance, SuggesterWFSTTest, DefaultValueUpdateProcessorTest, AutoCommitTest, SpellCheckComponentTest, TestSolr4Spatial, NumericFieldsTest, SolrCmdDistributorTest, SchemaVersionSpecificBehaviorTest, DateFieldTest, ResourceLoaderTest, DistanceFunctionTest, FileBasedSpellCheckerTest, TestQuerySenderNoQuery, TestLMDirichletSimilarityFactory, TestBinaryResponseWriter, TestConfig, TestFastLRUCache, SolrPluginUtilsTest, MoreLikeThisHandlerTest, DirectUpdateHandlerOptimizeTest, RequestHandlersTest, AlternateDirectoryTest, BinaryUpdateRequestHandlerTest, TestSolrIndexConfig, SampleTest, FastVectorHighlighterTest, HighlighterConfigTest, SolrCoreCheckLockOnStartupTest, SystemInfoHandlerTest, TestIndexSearcher, TestDistributedSearch, SpellCheckCollatorTest, TestExtendedDismaxParser, SoftAutoCommitTest, BasicZkTest, ZkSolrClientTest, TestFaceting, WordBreakSolrSpellCheckerTest, TestJoin, ConvertedLegacyTest, PeerSyncTest, QueryElevationComponentTest, SortByFunctionTest, TestJmxIntegration, HighlighterTest, TestTrie, SolrRequestParserTest, DirectSolrConnectionTest, TestRemoteStreaming, TestWordDelimiterFilterFactory, PolyFieldTest, SpatialFilterTest, DocumentBuilderTest, MBeansHandlerTest, CurrencyFieldTest, MinimalSchemaTest, StandardRequestHandlerTest, PingRequestHandlerTest, JsonLoaderTest, TestSolrQueryParser, JSONWriterTest, SuggesterFSTTest, TestArbitraryIndexDir, UniqFieldsUpdateProcessorFactoryTest, CSVRequestHandlerTest, BadIndexSchemaTest, NoCacheHeaderTest, BadComponentTest, TestBinaryField, TestSolrDeletionPolicy2, TestMergePolicyConfig, TestNumberUtils, SpellPossibilityIteratorTest, TestLMJelinekMercerSimilarityFactory, TestIBSimilarityFactory, TimeZoneUtilsTest, URLClassifyProcessorTest, FileUtilsTest, SpellingQueryConverterTest, TestLRUCache, UUIDFieldTest, TestUtils, AnalysisAfterCoreReloadTest, ClusterStateTest, ClusterStateUpdateTest, SyncSliceTest]
[junit4:junit4] Completed on J0 in 584.86s, 1 test, 1 failure <<< FAILURES!

[...truncated 36 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:352: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:178: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:438: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1175: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:839: There were test failures: 239 suites, 994 tests, 1 error, 2 failures, 7 ignored (2 assumptions)

Total time: 37 minutes 1 second
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 32bit/jdk1.8.0-ea-b65 -client -XX:+UseG1GC
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-4.x-Linux (32bit/ibm-j9-jdk7) - Build # 3184 - Still Failing!

Posted by Policeman Jenkins Server <je...@sd-datasolutions.de>.
Build: http://jenkins.sd-datasolutions.de/job/Lucene-Solr-4.x-Linux/3184/
Java: 32bit/ibm-j9-jdk7 

3 tests failed.
REGRESSION:  org.apache.solr.cloud.SyncSliceTest.testDistribSearch

Error Message:
There are still nodes recoverying - waited for 540 seconds

Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 540 seconds
	at __randomizedtesting.SeedInfo.seed([3DE0AAB4B07131DF:BC0624ACC72E51E3]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:165)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:115)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:110)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:563)
	at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:224)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
	at java.lang.reflect.Method.invoke(Method.java:613)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:780)


FAILED:  org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch

Error Message:
There are still nodes recoverying - waited for 540 seconds

Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 540 seconds
	at __randomizedtesting.SeedInfo.seed([3DE0AAB4B07131DF:BC0624ACC72E51E3]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:165)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:115)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:110)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:563)
	at org.apache.solr.cloud.BasicDistributedZk2Test.brindDownShardIndexSomeDocsAndRecover(BasicDistributedZk2Test.java:321)
	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:83)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
	at java.lang.reflect.Method.invoke(Method.java:613)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:780)


FAILED:  org.apache.solr.cloud.BasicDistributedZkTest.testDistribSearch

Error Message:
Server at http://127.0.0.1:41058/solr returned non ok status:500, message:Server Error

Stack Trace:
org.apache.solr.common.SolrException: Server at http://127.0.0.1:41058/solr returned non ok status:500, message:Server Error
	at __randomizedtesting.SeedInfo.seed([3DE0AAB4B07131DF:BC0624ACC72E51E3]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:372)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
	at org.apache.solr.client.solrj.request.CoreAdminRequest.process(CoreAdminRequest.java:429)
	at org.apache.solr.client.solrj.request.CoreAdminRequest.getStatus(CoreAdminRequest.java:472)
	at org.apache.solr.cloud.BasicDistributedZkTest.collectStartTimes(BasicDistributedZkTest.java:959)
	at org.apache.solr.cloud.BasicDistributedZkTest.testCollectionsAPI(BasicDistributedZkTest.java:795)
	at org.apache.solr.cloud.BasicDistributedZkTest.doTest(BasicDistributedZkTest.java:343)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
	at java.lang.reflect.Method.invoke(Method.java:613)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:780)




Build Log:
[...truncated 9051 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.SyncSliceTest
[junit4:junit4]   2> 4 T392 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-SyncSliceTest-1355323485284
[junit4:junit4]   2> 6 T392 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 8 T393 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 17 T393 oaz.Environment.logEnv Server environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
[junit4:junit4]   2> 17 T393 oaz.Environment.logEnv Server environment:host.name=serv1
[junit4:junit4]   2> 17 T393 oaz.Environment.logEnv Server environment:java.version=1.7.0
[junit4:junit4]   2> 17 T393 oaz.Environment.logEnv Server environment:java.vendor=IBM Corporation
[junit4:junit4]   2> 18 T393 oaz.Environment.logEnv Server environment:java.home=/opt/ibm/java-i386-70/jre
[junit4:junit4]   2> 18 T393 oaz.Environment.logEnv Server environment:java.class.path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/test:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/codecs/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-solrj/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/common/lucene-analyzers-common-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/highlighter/lucene-highlighter-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/memory/lucene-memory-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/misc/lucene-misc-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/spatial/lucene-spatial-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/suggest/lucene-suggest-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/grouping/lucene-grouping-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queries/lucene-queries-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queryparser/lucene-queryparser-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/cglib-nodep-2.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-cli-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-codec-1.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-fileupload-1.2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-lang-2.6.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/easymock-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/guava-13.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/javax.servlet-api-3.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/metrics-core-2.1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/objenesis-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/spatial4j-0.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/commons-io-2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpclient-4.1.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpcore-4.1.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpmime-4.1.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/jcl-over-slf4j-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/log4j-over-slf4j-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-api-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-jdk14-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/wstx-asl-3.2.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/zookeeper-3.4.5.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-continuation-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-deploy-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-http-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-io-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-jmx-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-security-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-server-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-servlet-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-util-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-webapp-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-xml-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/servlet-api-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/hsqldb-1.8.0.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/junit-4.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/randomizedtesting-runner-2.0.5.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-launcher.jar:/var/lib/jenkins/.ant/lib/ivy-2.2.0.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jdepend.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-netrexx.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-antlr.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-commons-net.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-javamail.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-regexp.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jsch.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-xalan2.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-junit4.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jmf.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-junit.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-bcel.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jai.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-commons-logging.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-resolver.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-oro.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-swing.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-bsf.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-log4j.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-testutil.jar:/opt/ibm/java-i386-70/lib/tools.jar:/var/lib/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.0.5.jar
[junit4:junit4]   2> 18 T393 oaz.Environment.logEnv Server environment:java.library.path=/opt/ibm/java-i386-70/jre/lib/i386/default:/opt/ibm/java-i386-70/jre/lib/i386:/usr/lib/jvm/j2sdk1.6-sun/jre/lib/amd64/server:/usr/lib/jvm/j2sdk1.6-sun/jre/lib/amd64:/usr/lib/jvm/j2sdk1.6-sun/jre/../lib/amd64:/usr/lib
[junit4:junit4]   2> 18 T393 oaz.Environment.logEnv Server environment:java.io.tmpdir=.
[junit4:junit4]   2> 19 T393 oaz.Environment.logEnv Server environment:java.compiler=j9jit26
[junit4:junit4]   2> 19 T393 oaz.Environment.logEnv Server environment:os.name=Linux
[junit4:junit4]   2> 19 T393 oaz.Environment.logEnv Server environment:os.arch=x86
[junit4:junit4]   2> 19 T393 oaz.Environment.logEnv Server environment:os.version=3.2.0-34-generic
[junit4:junit4]   2> 19 T393 oaz.Environment.logEnv Server environment:user.name=jenkins
[junit4:junit4]   2> 20 T393 oaz.Environment.logEnv Server environment:user.home=/var/lib/jenkins
[junit4:junit4]   2> 20 T393 oaz.Environment.logEnv Server environment:user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 26 T393 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 26 T393 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4]   2> 26 T393 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4]   2> 27 T393 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 40 T393 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1355323485284/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4]   2> 108 T392 oasc.ZkTestServer.run start zk server on port:36143
[junit4:junit4]   2> 119 T392 oaz.Environment.logEnv Client environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
[junit4:junit4]   2> 120 T392 oaz.Environment.logEnv Client environment:host.name=serv1
[junit4:junit4]   2> 120 T392 oaz.Environment.logEnv Client environment:java.version=1.7.0
[junit4:junit4]   2> 121 T392 oaz.Environment.logEnv Client environment:java.vendor=IBM Corporation
[junit4:junit4]   2> 121 T392 oaz.Environment.logEnv Client environment:java.home=/opt/ibm/java-i386-70/jre
[junit4:junit4]   2> 121 T392 oaz.Environment.logEnv Client environment:java.class.path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/test:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/codecs/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-solrj/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/common/lucene-analyzers-common-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/highlighter/lucene-highlighter-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/memory/lucene-memory-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/misc/lucene-misc-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/spatial/lucene-spatial-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/suggest/lucene-suggest-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/grouping/lucene-grouping-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queries/lucene-queries-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queryparser/lucene-queryparser-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/cglib-nodep-2.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-cli-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-codec-1.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-fileupload-1.2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-lang-2.6.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/easymock-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/guava-13.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/javax.servlet-api-3.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/metrics-core-2.1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/objenesis-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/spatial4j-0.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/commons-io-2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpclient-4.1.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpcore-4.1.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpmime-4.1.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/jcl-over-slf4j-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/log4j-over-slf4j-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-api-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-jdk14-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/wstx-asl-3.2.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/zookeeper-3.4.5.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-continuation-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-deploy-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-http-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-io-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-jmx-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-security-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-server-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-servlet-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-util-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-webapp-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-xml-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/servlet-api-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/hsqldb-1.8.0.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/junit-4.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/randomizedtesting-runner-2.0.5.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-launcher.jar:/var/lib/jenkins/.ant/lib/ivy-2.2.0.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jdepend.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-netrexx.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-antlr.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-commons-net.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-javamail.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-regexp.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jsch.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-xalan2.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-junit4.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jmf.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-junit.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-bcel.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jai.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-commons-logging.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-resolver.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-oro.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-swing.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-bsf.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-log4j.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-testutil.jar:/opt/ibm/java-i386-70/lib/tools.jar:/var/lib/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.0.5.jar
[junit4:junit4]   2> 122 T392 oaz.Environment.logEnv Client environment:java.library.path=/opt/ibm/java-i386-70/jre/lib/i386/default:/opt/ibm/java-i386-70/jre/lib/i386:/usr/lib/jvm/j2sdk1.6-sun/jre/lib/amd64/server:/usr/lib/jvm/j2sdk1.6-sun/jre/lib/amd64:/usr/lib/jvm/j2sdk1.6-sun/jre/../lib/amd64:/usr/lib
[junit4:junit4]   2> 123 T392 oaz.Environment.logEnv Client environment:java.io.tmpdir=.
[junit4:junit4]   2> 123 T392 oaz.Environment.logEnv Client environment:java.compiler=j9jit26
[junit4:junit4]   2> 124 T392 oaz.Environment.logEnv Client environment:os.name=Linux
[junit4:junit4]   2> 124 T392 oaz.Environment.logEnv Client environment:os.arch=x86
[junit4:junit4]   2> 125 T392 oaz.Environment.logEnv Client environment:os.version=3.2.0-34-generic
[junit4:junit4]   2> 125 T392 oaz.Environment.logEnv Client environment:user.name=jenkins
[junit4:junit4]   2> 126 T392 oaz.Environment.logEnv Client environment:user.home=/var/lib/jenkins
[junit4:junit4]   2> 126 T392 oaz.Environment.logEnv Client environment:user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 127 T392 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:36143 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@ba3d68f
[junit4:junit4]   2> 138 T392 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 141 T398 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:36143. Will not attempt to authenticate using SASL (Access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 142 T398 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:36143, initiating session
[junit4:junit4]   2> 142 T394 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:43560
[junit4:junit4]   2> 150 T394 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:43560
[junit4:junit4]   2> 153 T396 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 432 T396 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8f932c8e0000 with negotiated timeout 10000 for client /127.0.0.1:43560
[junit4:junit4]   2> 433 T398 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:36143, sessionid = 0x13b8f932c8e0000, negotiated timeout = 10000
[junit4:junit4]   2> 435 T399 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ba3d68f name:ZooKeeperConnection Watcher:127.0.0.1:36143 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 435 T392 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 436 T392 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 451 T397 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8f932c8e0000
[junit4:junit4]   2> 452 T399 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 452 T392 oaz.ZooKeeper.close Session: 0x13b8f932c8e0000 closed
[junit4:junit4]   2> 452 T394 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:43560 which had sessionid 0x13b8f932c8e0000
[junit4:junit4]   2> 453 T392 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:36143/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@8a49c085
[junit4:junit4]   2> 454 T400 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:36143. Will not attempt to authenticate using SASL (Access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 453 T392 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 454 T400 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:36143, initiating session
[junit4:junit4]   2> 454 T394 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:43561
[junit4:junit4]   2> 455 T394 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:43561
[junit4:junit4]   2> 456 T396 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8f932c8e0001 with negotiated timeout 10000 for client /127.0.0.1:43561
[junit4:junit4]   2> 456 T400 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:36143, sessionid = 0x13b8f932c8e0001, negotiated timeout = 10000
[junit4:junit4]   2> 456 T401 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@8a49c085 name:ZooKeeperConnection Watcher:127.0.0.1:36143/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 456 T392 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 458 T392 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 463 T392 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 468 T392 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 471 T392 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 475 T392 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 476 T392 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 496 T392 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 497 T392 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 503 T392 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 504 T392 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 509 T392 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 510 T392 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 514 T392 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 514 T392 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 519 T392 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 519 T392 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 524 T392 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 525 T392 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 529 T392 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 529 T392 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 534 T392 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 534 T392 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 538 T392 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 539 T392 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 547 T397 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8f932c8e0001
[junit4:junit4]   2> 548 T394 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:43561 which had sessionid 0x13b8f932c8e0001
[junit4:junit4]   2> 549 T401 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 549 T392 oaz.ZooKeeper.close Session: 0x13b8f932c8e0001 closed
[junit4:junit4]   2> 610 T392 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 634 T392 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:51457
[junit4:junit4]   2> 635 T392 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 636 T392 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1355323485829
[junit4:junit4]   2> 636 T392 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1355323485829/'
[junit4:junit4]   2> 646 T392 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 647 T392 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 647 T392 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1355323485829
[junit4:junit4]   2> 648 T392 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1355323485829/solr.xml
[junit4:junit4]   2> 649 T392 oasc.CoreContainer.<init> New CoreContainer 1053280073
[junit4:junit4]   2> 649 T392 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1355323485829/'
[junit4:junit4]   2> 650 T392 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1355323485829/'
[junit4:junit4]   2> 663 T392 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 671 T392 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:36143/solr
[junit4:junit4]   2> 677 T392 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 677 T392 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:36143 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@36e4bed7
[junit4:junit4]   2> 678 T392 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 691 T411 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:36143. Will not attempt to authenticate using SASL (Access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 691 T411 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:36143, initiating session
[junit4:junit4]   2> 692 T394 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:43562
[junit4:junit4]   2> 692 T394 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:43562
[junit4:junit4]   2> 694 T396 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8f932c8e0002 with negotiated timeout 20000 for client /127.0.0.1:43562
[junit4:junit4]   2> 694 T411 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:36143, sessionid = 0x13b8f932c8e0002, negotiated timeout = 20000
[junit4:junit4]   2> 694 T412 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@36e4bed7 name:ZooKeeperConnection Watcher:127.0.0.1:36143 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 694 T392 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 696 T397 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8f932c8e0002
[junit4:junit4]   2> 696 T394 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:43562 which had sessionid 0x13b8f932c8e0002
[junit4:junit4]   2> 696 T392 oaz.ZooKeeper.close Session: 0x13b8f932c8e0002 closed
[junit4:junit4]   2> 697 T412 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 698 T392 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:36143/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@ae166aea
[junit4:junit4]   2> 699 T413 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:36143. Will not attempt to authenticate using SASL (Access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 699 T392 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 699 T413 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:36143, initiating session
[junit4:junit4]   2> 700 T394 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:43563
[junit4:junit4]   2> 700 T394 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:43563
[junit4:junit4]   2> 701 T396 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8f932c8e0003 with negotiated timeout 8000 for client /127.0.0.1:43563
[junit4:junit4]   2> 701 T413 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:36143, sessionid = 0x13b8f932c8e0003, negotiated timeout = 8000
[junit4:junit4]   2> 701 T414 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ae166aea name:ZooKeeperConnection Watcher:127.0.0.1:36143/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 702 T392 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 706 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f932c8e0003 type:create cxid:0x2 zxid:0x1b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 709 T392 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 711 T392 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51457_solr
[junit4:junit4]   2> 713 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f932c8e0003 type:delete cxid:0x7 zxid:0x1d txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:51457_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:51457_solr
[junit4:junit4]   2> 713 T392 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51457_solr
[junit4:junit4]   2> 717 T392 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 717 T392 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 718 T392 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 718 T392 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 719 T392 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 719 T392 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 720 T392 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 721 T392 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 721 T392 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 722 T392 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 726 T392 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 742 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f932c8e0003 type:delete cxid:0x15 zxid:0x22 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 743 T392 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 747 T392 oasc.Overseer.start Overseer (id=88822479934324739-127.0.0.1:51457_solr-n_0000000000) starting
[junit4:junit4]   2> 748 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f932c8e0003 type:create cxid:0x1a zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 752 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f932c8e0003 type:create cxid:0x1b zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 753 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f932c8e0003 type:create cxid:0x1c zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 756 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f932c8e0003 type:create cxid:0x1d zxid:0x27 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 758 T416 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
[junit4:junit4]   2> 758 T392 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 763 T392 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 770 T415 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 775 T417 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1355323485829/collection1
[junit4:junit4]   2> 775 T417 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4]   2> 776 T417 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 776 T417 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4]   2> 778 T417 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1355323485829/collection1/'
[junit4:junit4]   2> 779 T417 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1355323485829/collection1/lib/README' to classloader
[junit4:junit4]   2> 780 T417 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1355323485829/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 818 T417 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 857 T417 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 858 T417 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 863 T417 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 1324 T417 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 1328 T417 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 1331 T417 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 1344 T417 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1348 T417 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1353 T417 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1354 T417 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1356 T417 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1355323485829/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1355323485284/control/data/
[junit4:junit4]   2> 1357 T417 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@70d2c937
[junit4:junit4]   2> 1360 T417 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1355323485284/control/data/index/
[junit4:junit4]   2> 1360 T417 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1355323485284/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 1360 T417 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1355323485284/control/data/index forceNew:false
[junit4:junit4]   2> 1376 T417 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1355323485284/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@64586b56),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 1377 T417 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 1377 T417 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 1378 T417 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 1379 T417 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 1379 T417 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 1379 T417 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 1380 T417 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 1380 T417 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 1380 T417 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 1381 T417 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 1382 T417 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 1382 T417 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 1383 T417 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 1383 T417 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 1384 T417 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 1384 T417 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 1384 T417 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 1385 T417 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 1386 T417 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1386 T417 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1387 T417 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1388 T417 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1388 T417 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1389 T417 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1390 T417 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1390 T417 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 1391 T417 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 1392 T417 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 1393 T417 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 1395 T417 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [OLD_SYNONYMS.TXT, PROTWORDS.TXT, STOPWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, CURRENCY.XML, SCHEMA.XML, SYNONYMS.TXT, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 1397 T417 oass.SolrIndexSearcher.<init> Opening Searcher@a5c90aa6 main
[junit4:junit4]   2> 1397 T417 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 1401 T417 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 1401 T417 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 1402 T417 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 1405 T417 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 1424 T418 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@a5c90aa6 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 1427 T417 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 1427 T417 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 1428 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f932c8e0003 type:create cxid:0x53 zxid:0x2a txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 1432 T417 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 1432 T417 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:51457/solr shardId:control_shard
[junit4:junit4]   2> 1434 T417 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4]   2> 1438 T417 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/control_shard/election
[junit4:junit4]   2> 1446 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f932c8e0003 type:delete cxid:0x62 zxid:0x31 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4]   2> 1447 T417 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 1448 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f932c8e0003 type:create cxid:0x63 zxid:0x32 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1779 T415 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 1780 T415 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:51457/solr",
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:51457_solr",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "shard":"control_shard",
[junit4:junit4]   2> 	  "core":"collection1"}
[junit4:junit4]   2> 1782 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f932c8e0003 type:create cxid:0x6a zxid:0x34 txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 1851 T414 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 1950 T417 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 1950 T417 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 1951 T417 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:51457/solr/collection1/
[junit4:junit4]   2> 1951 T417 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 1951 T417 oasc.SyncStrategy.syncToMe http://127.0.0.1:51457/solr/collection1/ has no replicas
[junit4:junit4]   2> 1952 T417 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:51457/solr/collection1/
[junit4:junit4]   2> 1952 T417 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/control_shard
[junit4:junit4]   2> 1958 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f932c8e0003 type:create cxid:0x89 zxid:0x3f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2360 T415 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2366 T414 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 2411 T417 oasc.ZkController.register We are http://127.0.0.1:51457/solr/collection1/ and leader is http://127.0.0.1:51457/solr/collection1/
[junit4:junit4]   2> 2412 T417 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51457/solr
[junit4:junit4]   2> 2413 T417 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 2413 T417 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 2413 T417 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 2416 T417 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2417 T392 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 2418 T392 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 2419 T392 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 2497 T392 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 2499 T392 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:46241
[junit4:junit4]   2> 2500 T392 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 2500 T392 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355323487705
[junit4:junit4]   2> 2501 T392 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355323487705/'
[junit4:junit4]   2> 2511 T392 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 2512 T392 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 2513 T392 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355323487705
[junit4:junit4]   2> 2513 T392 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355323487705/solr.xml
[junit4:junit4]   2> 2514 T392 oasc.CoreContainer.<init> New CoreContainer 1941632501
[junit4:junit4]   2> 2514 T392 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355323487705/'
[junit4:junit4]   2> 2515 T392 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355323487705/'
[junit4:junit4]   2> 2527 T392 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 2537 T392 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:36143/solr
[junit4:junit4]   2> 2537 T392 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 2538 T392 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:36143 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@c4fe2023
[junit4:junit4]   2> 2540 T428 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:36143. Will not attempt to authenticate using SASL (Access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 2540 T392 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2540 T428 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:36143, initiating session
[junit4:junit4]   2> 2540 T394 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:43568
[junit4:junit4]   2> 2541 T394 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:43568
[junit4:junit4]   2> 2541 T396 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8f932c8e0004 with negotiated timeout 20000 for client /127.0.0.1:43568
[junit4:junit4]   2> 2541 T428 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:36143, sessionid = 0x13b8f932c8e0004, negotiated timeout = 20000
[junit4:junit4]   2> 2542 T429 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@c4fe2023 name:ZooKeeperConnection Watcher:127.0.0.1:36143 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2542 T392 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2543 T397 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8f932c8e0004
[junit4:junit4]   2> 2544 T429 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 2544 T394 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:43568 which had sessionid 0x13b8f932c8e0004
[junit4:junit4]   2> 2544 T392 oaz.ZooKeeper.close Session: 0x13b8f932c8e0004 closed
[junit4:junit4]   2> 2545 T392 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:36143/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@4548bbe5
[junit4:junit4]   2> 2546 T430 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:36143. Will not attempt to authenticate using SASL (Access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 2546 T392 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2546 T430 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:36143, initiating session
[junit4:junit4]   2> 2546 T394 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:43569
[junit4:junit4]   2> 2547 T394 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:43569
[junit4:junit4]   2> 2548 T396 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8f932c8e0005 with negotiated timeout 8000 for client /127.0.0.1:43569
[junit4:junit4]   2> 2548 T430 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:36143, sessionid = 0x13b8f932c8e0005, negotiated timeout = 8000
[junit4:junit4]   2> 2549 T431 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4548bbe5 name:ZooKeeperConnection Watcher:127.0.0.1:36143/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2549 T392 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2550 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f932c8e0005 type:create cxid:0x1 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2552 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f932c8e0005 type:create cxid:0x2 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2553 T392 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46241_solr
[junit4:junit4]   2> 2554 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f932c8e0005 type:delete cxid:0x4 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:46241_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:46241_solr
[junit4:junit4]   2> 2554 T392 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:46241_solr
[junit4:junit4]   2> 2557 T414 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 2557 T414 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 2558 T392 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 2559 T392 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 2559 T392 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 2560 T392 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 2561 T392 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 2562 T392 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 2563 T392 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 2563 T392 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 2564 T392 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 2565 T392 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 2573 T392 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 2579 T432 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355323487705/collection1
[junit4:junit4]   2> 2579 T432 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 2579 T432 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 2580 T432 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 2581 T432 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355323487705/collection1/'
[junit4:junit4]   2> 2581 T432 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty1-1355323487705/collection1/lib/README' to classloader
[junit4:junit4]   2> 2582 T432 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty1-1355323487705/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 2609 T432 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 2657 T432 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 2659 T432 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 2663 T432 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 2871 T415 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2872 T415 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:51457/solr",
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:51457_solr",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "shard":"control_shard",
[junit4:junit4]   2> 	  "core":"collection1"}
[junit4:junit4]   2> 2877 T431 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 2877 T414 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 2986 T432 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 2990 T432 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 2993 T432 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 3012 T432 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 3017 T432 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 3021 T432 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 3022 T432 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 3024 T432 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355323487705/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1355323485284/jetty1/
[junit4:junit4]   2> 3024 T432 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@70d2c937
[junit4:junit4]   2> 3025 T432 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1355323485284/jetty1/index/
[junit4:junit4]   2> 3025 T432 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1355323485284/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 3025 T432 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1355323485284/jetty1/index forceNew:false
[junit4:junit4]   2> 3066 T432 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1355323485284/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@dd9da2ee),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 3067 T432 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 3068 T432 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 3069 T432 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 3069 T432 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 3070 T432 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 3070 T432 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 3071 T432 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 3071 T432 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 3071 T432 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 3072 T432 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 3073 T432 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 3073 T432 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 3074 T432 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 3074 T432 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 3075 T432 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 3075 T432 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 3076 T432 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 3076 T432 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 3077 T432 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3078 T432 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3078 T432 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3079 T432 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3080 T432 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3081 T432 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3081 T432 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3082 T432 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 3083 T432 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 3084 T432 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 3085 T432 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 3087 T432 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [OLD_SYNONYMS.TXT, PROTWORDS.TXT, STOPWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, CURRENCY.XML, SCHEMA.XML, SYNONYMS.TXT, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 3089 T432 oass.SolrIndexSearcher.<init> Opening Searcher@b89b22cc main
[junit4:junit4]   2> 3089 T432 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 3090 T432 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 3090 T432 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 3090 T432 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 3094 T432 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 3124 T433 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@b89b22cc main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 3131 T432 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 3132 T432 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 3382 T415 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3383 T415 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:46241/solr",
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:46241_solr",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "core":"collection1"}
[junit4:junit4]   2> 3384 T415 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 1
[junit4:junit4]   2> 3385 T415 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 3409 T431 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3409 T414 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3635 T432 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 3635 T432 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:46241/solr shardId:shard1
[junit4:junit4]   2> 3637 T432 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 3653 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f932c8e0005 type:delete cxid:0x45 zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 3654 T432 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 3656 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f932c8e0005 type:create cxid:0x46 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3660 T432 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 3660 T432 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 3661 T432 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:46241/solr/collection1/
[junit4:junit4]   2> 3662 T432 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 3662 T432 oasc.SyncStrategy.syncToMe http://127.0.0.1:46241/solr/collection1/ has no replicas
[junit4:junit4]   2> 3663 T432 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:46241/solr/collection1/
[junit4:junit4]   2> 3664 T432 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 3673 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f932c8e0005 type:create cxid:0x50 zxid:0x60 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3916 T415 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3945 T431 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3945 T414 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3978 T432 oasc.ZkController.register We are http://127.0.0.1:46241/solr/collection1/ and leader is http://127.0.0.1:46241/solr/collection1/
[junit4:junit4]   2> 3979 T432 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:46241/solr
[junit4:junit4]   2> 3979 T432 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 3980 T432 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 3980 T432 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 3984 T432 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3987 T392 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 3988 T392 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 3990 T392 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 4064 T392 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 4066 T392 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:39965
[junit4:junit4]   2> 4067 T392 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 4068 T392 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355323489276
[junit4:junit4]   2> 4068 T392 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355323489276/'
[junit4:junit4]   2> 4078 T392 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 4079 T392 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 4079 T392 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355323489276
[junit4:junit4]   2> 4080 T392 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355323489276/solr.xml
[junit4:junit4]   2> 4080 T392 oasc.CoreContainer.<init> New CoreContainer -1084205056
[junit4:junit4]   2> 4081 T392 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355323489276/'
[junit4:junit4]   2> 4081 T392 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355323489276/'
[junit4:junit4]   2> 4093 T392 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 4102 T392 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:36143/solr
[junit4:junit4]   2> 4103 T392 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 4103 T392 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:36143 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@d008d42d
[junit4:junit4]   2> 4104 T443 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:36143. Will not attempt to authenticate using SASL (Access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 4104 T392 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4105 T443 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:36143, initiating session
[junit4:junit4]   2> 4105 T394 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:43574
[junit4:junit4]   2> 4105 T394 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:43574
[junit4:junit4]   2> 4106 T396 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8f932c8e0006 with negotiated timeout 20000 for client /127.0.0.1:43574
[junit4:junit4]   2> 4106 T443 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:36143, sessionid = 0x13b8f932c8e0006, negotiated timeout = 20000
[junit4:junit4]   2> 4107 T444 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d008d42d name:ZooKeeperConnection Watcher:127.0.0.1:36143 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4107 T392 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4108 T397 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8f932c8e0006
[junit4:junit4]   2> 4109 T394 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:43574 which had sessionid 0x13b8f932c8e0006
[junit4:junit4]   2> 4109 T444 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 4109 T392 oaz.ZooKeeper.close Session: 0x13b8f932c8e0006 closed
[junit4:junit4]   2> 4110 T392 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:36143/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@f97dd623
[junit4:junit4]   2> 4111 T445 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:36143. Will not attempt to authenticate using SASL (Access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 4111 T392 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4111 T445 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:36143, initiating session
[junit4:junit4]   2> 4111 T394 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:43575
[junit4:junit4]   2> 4112 T394 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:43575
[junit4:junit4]   2> 4112 T396 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8f932c8e0007 with negotiated timeout 8000 for client /127.0.0.1:43575
[junit4:junit4]   2> 4112 T445 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:36143, sessionid = 0x13b8f932c8e0007, negotiated timeout = 8000
[junit4:junit4]   2> 4113 T446 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f97dd623 name:ZooKeeperConnection Watcher:127.0.0.1:36143/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4113 T392 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4114 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f932c8e0007 type:create cxid:0x1 zxid:0x6d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4115 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f932c8e0007 type:create cxid:0x2 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4116 T392 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39965_solr
[junit4:junit4]   2> 4117 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f932c8e0007 type:delete cxid:0x4 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:39965_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:39965_solr
[junit4:junit4]   2> 4117 T392 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:39965_solr
[junit4:junit4]   2> 4120 T431 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 4120 T414 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 4120 T414 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4121 T392 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 4122 T392 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 4122 T431 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 4122 T392 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 4123 T392 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 4123 T392 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 4124 T392 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 4125 T392 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 4126 T392 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 4127 T392 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 4129 T392 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 4141 T392 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 4150 T447 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355323489276/collection1
[junit4:junit4]   2> 4150 T447 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 4151 T447 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 4151 T447 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 4154 T447 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355323489276/collection1/'
[junit4:junit4]   2> 4155 T447 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty2-1355323489276/collection1/lib/README' to classloader
[junit4:junit4]   2> 4156 T447 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty2-1355323489276/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 4208 T447 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 4241 T447 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 4243 T447 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 4247 T447 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 4457 T415 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4458 T415 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:46241/solr",
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:46241_solr",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "core":"collection1"}
[junit4:junit4]   2> 4462 T431 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4462 T446 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4462 T414 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4551 T447 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 4556 T447 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 4558 T447 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 4573 T447 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 4577 T447 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 4581 T447 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 4582 T447 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 4583 T447 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355323489276/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1355323485284/jetty2/
[junit4:junit4]   2> 4584 T447 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@70d2c937
[junit4:junit4]   2> 4584 T447 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1355323485284/jetty2/index/
[junit4:junit4]   2> 4585 T447 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1355323485284/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 4585 T447 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1355323485284/jetty2/index forceNew:false
[junit4:junit4]   2> 4598 T447 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1355323485284/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@bffa16b2),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 4598 T447 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 4599 T447 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 4600 T447 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 4600 T447 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 4600 T447 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 4608 T447 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 4609 T447 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 4609 T447 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 4610 T447 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 4610 T447 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 4611 T447 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 4612 T447 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 4613 T447 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 4613 T447 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 4614 T447 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 4614 T447 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 4614 T447 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 4615 T447 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 4616 T447 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4616 T447 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4617 T447 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4618 T447 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4619 T447 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4619 T447 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4620 T447 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4621 T447 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 4621 T447 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 4623 T447 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 4624 T447 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 4625 T447 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [OLD_SYNONYMS.TXT, PROTWORDS.TXT, STOPWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, CURRENCY.XML, SCHEMA.XML, SYNONYMS.TXT, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 4627 T447 oass.SolrIndexSearcher.<init> Opening Searcher@299ca1e4 main
[junit4:junit4]   2> 4627 T447 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 4628 T447 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 4628 T447 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 4629 T447 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 4632 T447 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 4653 T448 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@299ca1e4 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 4660 T447 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 4661 T447 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 4968 T415 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4969 T415 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:39965/solr",
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:39965_solr",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "core":"collection1"}
[junit4:junit4]   2> 4969 T415 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 4970 T415 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 5215 T431 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5215 T414 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5215 T446 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5662 T447 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 5663 T447 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:39965/solr shardId:shard1
[junit4:junit4]   2> 5678 T447 oasc.ZkController.register We are http://127.0.0.1:39965/solr/collection1/ and leader is http://127.0.0.1:46241/solr/collection1/
[junit4:junit4]   2> 5678 T447 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:39965/solr
[junit4:junit4]   2> 5679 T447 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 5679 T447 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C57 name=collection1 org.apache.solr.core.SolrCore@920d710c url=http://127.0.0.1:39965/solr/collection1 node=127.0.0.1:39965_solr
[junit4:junit4]   2> 5682 T449 C57 P39965 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 5682 T449 C57 P39965 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 5683 T449 C57 P39965 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 5683 T449 C57 P39965 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 5683 T447 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5685 T449 C57 P39965 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:46241/solr/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 5687 T392 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 5688 T392 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 5688 T449 C57 P39965 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4]   2> 5688 T392 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 5695 T449 C57 P39965 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:39965/solr START replicas=[http://127.0.0.1:46241/solr/collection1/] nUpdates=100
[junit4:junit4]   2> 5696 T449 C57 P39965 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 5696 T449 C57 P39965 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 5696 T449 C57 P39965 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 5697 T449 C57 P39965 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C58 name=collection1 org.apache.solr.core.SolrCore@339f5630 url=http://127.0.0.1:46241/solr/collection1 node=127.0.0.1:46241_solr
[junit4:junit4]   2> 5701 T424 C58 P46241 REQ /get {version=2&getVersions=100&qt=/get&wt=javabin&distrib=false} status=0 QTime=0 
[junit4:junit4]   2> 5722 T415 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5724 T415 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:39965/solr",
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:39965_solr",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "core":"collection1"}
[junit4:junit4]   2> 5730 T431 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5730 T446 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5731 T414 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5777 T392 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 5780 T392 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:48563
[junit4:junit4]   2> 5781 T392 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 5782 T392 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355323490973
[junit4:junit4]   2> 5783 T392 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355323490973/'
[junit4:junit4]   2> 5798 T392 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 5799 T392 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 5800 T392 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355323490973
[junit4:junit4]   2> 5801 T392 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355323490973/solr.xml
[junit4:junit4]   2> 5802 T392 oasc.CoreContainer.<init> New CoreContainer 598520418
[junit4:junit4]   2> 5803 T392 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355323490973/'
[junit4:junit4]   2> 5803 T392 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355323490973/'
[junit4:junit4]   2> 5817 T392 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 5826 T392 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:36143/solr
[junit4:junit4]   2> 5827 T392 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 5827 T392 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:36143 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@aa026d48
[junit4:junit4]   2> 5829 T460 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:36143. Will not attempt to authenticate using SASL (Access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 5829 T392 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 5829 T460 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:36143, initiating session
[junit4:junit4]   2> 5830 T394 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:43580
[junit4:junit4]   2> 5830 T394 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:43580
[junit4:junit4]   2> 5831 T396 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8f932c8e0008 with negotiated timeout 20000 for client /127.0.0.1:43580
[junit4:junit4]   2> 5831 T460 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:36143, sessionid = 0x13b8f932c8e0008, negotiated timeout = 20000
[junit4:junit4]   2> 5832 T461 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@aa026d48 name:ZooKeeperConnection Watcher:127.0.0.1:36143 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 5832 T392 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 5835 T397 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8f932c8e0008
[junit4:junit4]   2> 5835 T394 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:43580 which had sessionid 0x13b8f932c8e0008
[junit4:junit4]   2> 5835 T392 oaz.ZooKeeper.close Session: 0x13b8f932c8e0008 closed
[junit4:junit4]   2> 5836 T392 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:36143/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@b349a37e
[junit4:junit4]   2> 5837 T461 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 5837 T392 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 5838 T462 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:36143. Will not attempt to authenticate using SASL (Access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 5839 T462 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:36143, initiating session
[junit4:junit4]   2> 5839 T394 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:43581
[junit4:junit4]   2> 5839 T394 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:43581
[junit4:junit4]   2> 5840 T396 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8f932c8e0009 with negotiated timeout 8000 for client /127.0.0.1:43581
[junit4:junit4]   2> 5840 T462 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:36143, sessionid = 0x13b8f932c8e0009, negotiated timeout = 8000
[junit4:junit4]   2> 5841 T463 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b349a37e name:ZooKeeperConnection Watcher:127.0.0.1:36143/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 5841 T392 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 5842 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f932c8e0009 type:create cxid:0x1 zxid:0x84 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5843 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f932c8e0009 type:create cxid:0x2 zxid:0x85 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5845 T392 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48563_solr
[junit4:junit4]   2> 5846 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f932c8e0009 type:delete cxid:0x4 zxid:0x86 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:48563_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:48563_solr
[junit4:junit4]   2> 5846 T392 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:48563_solr
[junit4:junit4]   2> 5850 T431 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5850 T446 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5851 T414 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 5852 T414 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5854 T431 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 5854 T392 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 5857 T392 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 5858 T392 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 5859 T446 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 5859 T392 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 5860 T392 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 5861 T392 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 5862 T392 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 5863 T392 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 5864 T392 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 5866 T392 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 5888 T392 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 5897 T464 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355323490973/collection1
[junit4:junit4]   2> 5897 T464 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 5899 T464 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 5899 T464 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 5901 T464 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355323490973/collection1/'
[junit4:junit4]   2> 5902 T464 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty3-1355323490973/collection1/lib/README' to classloader
[junit4:junit4]   2> 5902 T464 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty3-1355323490973/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 5932 T464 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 5970 T464 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 5972 T464 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 5976 T464 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 6460 T464 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 6467 T464 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 6470 T464 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 6486 T464 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 6492 T464 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 6498 T464 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 6503 T464 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 6506 T464 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355323490973/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1355323485284/jetty3/
[junit4:junit4]   2> 6507 T464 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@70d2c937
[junit4:junit4]   2> 6508 T464 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1355323485284/jetty3/index/
[junit4:junit4]   2> 6508 T464 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1355323485284/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 6509 T464 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1355323485284/jetty3/index forceNew:false
[junit4:junit4]   2> 6536 T464 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1355323485284/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@b9e0d74e),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 6537 T464 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 6538 T464 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 6540 T464 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 6540 T464 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 6541 T464 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 6541 T464 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 6543 T464 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 6544 T464 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 6544 T464 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 6546 T464 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 6548 T464 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 6549 T464 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 6550 T464 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 6550 T464 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 6551 T464 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 6551 T464 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 6552 T464 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 6552 T464 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 6553 T464 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6554 T464 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6555 T464 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6555 T464 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6556 T464 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6557 T464 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6557 T464 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6558 T464 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 6559 T464 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 6560 T464 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 6561 T464 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 6564 T464 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [OLD_SYNONYMS.TXT, PROTWORDS.TXT, STOPWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, CURRENCY.XML, SCHEMA.XML, SYNONYMS.TXT, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 6566 T464 oass.SolrIndexSearcher.<init> Opening Searcher@a5654a45 main
[junit4:junit4]   2> 6567 T464 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 6568 T464 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 6568 T464 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 6569 T464 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 6576 T464 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 6597 T465 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@a5654a45 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 6601 T464 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 6602 T464 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 6739 T415 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6741 T415 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:48563/solr",
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:48563_solr",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "core":"collection1"}
[junit4:junit4]   2> 6741 T415 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 6741 T415 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 6750 T431 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6750 T414 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6750 T446 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6750 T463 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 7104 T464 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 7104 T464 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:48563/solr shardId:shard1
[junit4:junit4]   2> 7108 T464 oasc.ZkController.register We are http://127.0.0.1:48563/solr/collection1/ and leader is http://127.0.0.1:46241/solr/collection1/
[junit4:junit4]   2> 7108 T464 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:48563/solr
[junit4:junit4]   2> 7109 T464 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 7109 T464 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C59 name=collection1 org.apache.solr.core.SolrCore@9b5eed65 url=http://127.0.0.1:48563/solr/collection1 node=127.0.0.1:48563_solr
[junit4:junit4]   2> 7109 T466 C59 P48563 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 7110 T466 C59 P48563 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 7110 T464 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7111 T466 C59 P48563 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 7112 T466 C59 P48563 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 7113 T392 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 7114 T392 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 7115 T392 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 7115 T466 C59 P48563 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:46241/solr/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 7116 T466 C59 P48563 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:48563/solr START replicas=[http://127.0.0.1:46241/solr/collection1/] nUpdates=100
[junit4:junit4]   2> 7116 T466 C59 P48563 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 7116 T466 C59 P48563 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 7116 T466 C59 P48563 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 7117 T466 C59 P48563 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 7126 T425 C58 P46241 REQ /get {version=2&getVersions=100&qt=/get&wt=javabin&distrib=false} status=0 QTime=0 
[junit4:junit4]   2> 7199 T392 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 7201 T392 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:35429
[junit4:junit4]   2> 7202 T392 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 7202 T392 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355323492400
[junit4:junit4]   2> 7203 T392 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355323492400/'
[junit4:junit4]   2> 7213 T392 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 7213 T392 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 7214 T392 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355323492400
[junit4:junit4]   2> 7214 T392 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355323492400/solr.xml
[junit4:junit4]   2> 7215 T392 oasc.CoreContainer.<init> New CoreContainer 163504216
[junit4:junit4]   2> 7215 T392 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355323492400/'
[junit4:junit4]   2> 7216 T392 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355323492400/'
[junit4:junit4]   2> 7247 T392 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 7257 T415 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7259 T415 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:48563/solr",
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:48563_solr",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "core":"collection1"}
[junit4:junit4]   2> 7262 T392 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:36143/solr
[junit4:junit4]   2> 7263 T392 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 7263 T392 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:36143 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@833e096e
[junit4:junit4]   2> 7265 T477 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:36143. Will not attempt to authenticate using SASL (Access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 7265 T392 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 7266 T394 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:43583
[junit4:junit4]   2> 7266 T477 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:36143, initiating session
[junit4:junit4]   2> 7267 T394 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:43583
[junit4:junit4]   2> 7285 T446 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 7285 T431 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 7285 T463 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 7285 T414 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 7287 T396 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8f932c8e000a with negotiated timeout 20000 for client /127.0.0.1:43583
[junit4:junit4]   2> 7287 T477 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:36143, sessionid = 0x13b8f932c8e000a, negotiated timeout = 20000
[junit4:junit4]   2> 7288 T478 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@833e096e name:ZooKeeperConnection Watcher:127.0.0.1:36143 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 7289 T392 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 7292 T397 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8f932c8e000a
[junit4:junit4]   2> 7292 T394 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:43583 which had sessionid 0x13b8f932c8e000a
[junit4:junit4]   2> 7293 T392 oaz.ZooKeeper.close Session: 0x13b8f932c8e000a closed
[junit4:junit4]   2> 7294 T392 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:36143/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@e55117ab
[junit4:junit4]   2> 7294 T478 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 7296 T479 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:36143. Will not attempt to authenticate using SASL (Access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 7296 T392 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 7297 T394 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:43584
[junit4:junit4]   2> 7298 T479 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:36143, initiating session
[junit4:junit4]   2> 7298 T394 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:43584
[junit4:junit4]   2> 7299 T396 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8f932c8e000b with negotiated timeout 8000 for client /127.0.0.1:43584
[junit4:junit4]   2> 7300 T479 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:36143, sessionid = 0x13b8f932c8e000b, negotiated timeout = 8000
[junit4:junit4]   2> 7301 T480 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e55117ab name:ZooKeeperConnection Watcher:127.0.0.1:36143/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 7301 T392 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 7302 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f932c8e000b type:create cxid:0x1 zxid:0x97 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 7304 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f932c8e000b type:create cxid:0x2 zxid:0x98 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 7305 T392 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35429_solr
[junit4:junit4]   2> 7306 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f932c8e000b type:delete cxid:0x4 zxid:0x99 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:35429_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:35429_solr
[junit4:junit4]   2> 7307 T392 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:35429_solr
[junit4:junit4]   2> 7310 T446 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 7310 T431 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 7311 T463 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 7311 T463 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7311 T414 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 7312 T414 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7314 T392 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 7315 T446 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 7315 T392 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 7316 T431 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 7316 T392 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 7317 T392 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 7318 T392 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 7319 T392 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 7320 T392 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 7321 T392 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 7322 T392 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 7323 T392 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 7335 T392 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 7344 T481 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355323492400/collection1
[junit4:junit4]   2> 7344 T481 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 7345 T481 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 7346 T481 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 7347 T481 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355323492400/collection1/'
[junit4:junit4]   2> 7348 T481 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty4-1355323492400/collection1/lib/README' to classloader
[junit4:junit4]   2> 7349 T481 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty4-1355323492400/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 7395 T481 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 7431 T481 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 7432 T481 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 7439 T481 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 7847 T481 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 7852 T481 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 7854 T481 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 7869 T481 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 7874 T481 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 7878 T481 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 7880 T481 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 7881 T481 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355323492400/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1355323485284/jetty4/
[junit4:junit4]   2> 7882 T481 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@70d2c937
[junit4:junit4]   2> 7882 T481 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1355323485284/jetty4/index/
[junit4:junit4]   2> 7882 T481 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1355323485284/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 7883 T481 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1355323485284/jetty4/index forceNew:false
[junit4:junit4]   2> 7924 T481 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1355323485284/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@f553420e),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 7925 T481 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 7925 T481 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 7927 T481 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 7927 T481 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 7927 T481 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 7928 T481 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 7928 T481 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 7928 T481 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 7929 T481 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 7930 T481 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 7930 T481 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 7931 T481 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 7932 T481 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 7932 T481 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 7933 T481 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 7933 T481 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 7933 T481 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 7934 T481 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 7935 T481 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7935 T481 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7936 T481 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7937 T481 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7938 T481 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7938 T481 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7939 T481 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7940 T481 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 7940 T481 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 7942 T481 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 7943 T481 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 7944 T481 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [OLD_SYNONYMS.TXT, PROTWORDS.TXT, STOPWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, CURRENCY.XML, SCHEMA.XML, SYNONYMS.TXT, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 7946 T481 oass.SolrIndexSearcher.<init> Opening Searcher@c1106f4f main
[junit4:junit4]   2> 7947 T481 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 7947 T481 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 7948 T481 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 7948 T481 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 7952 T481 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 7976 T482 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@c1106f4f main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 7983 T481 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 7983 T481 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 8296 T415 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8297 T415 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:35429/solr",
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:35429_solr",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "core":"collection1"}
[junit4:junit4]   2> 8297 T415 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 8298 T415 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 8302 T431 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8302 T446 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8302 T414 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8303 T480 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8303 T463 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8485 T481 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 8486 T481 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:35429/solr shardId:shard1
[junit4:junit4]   2> 8490 T481 oasc.ZkController.register We are http://127.0.0.1:35429/solr/collection1/ and leader is http://127.0.0.1:46241/solr/collection1/
[junit4:junit4]   2> 8490 T481 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:35429/solr
[junit4:junit4]   2> 8491 T481 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 8491 T481 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C60 name=collection1 org.apache.solr.core.SolrCore@93785515 url=http://127.0.0.1:35429/solr/collection1 node=127.0.0.1:35429_solr
[junit4:junit4]   2> 8491 T483 C60 P35429 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 8492 T483 C60 P35429 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 8492 T481 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8492 T483 C60 P35429 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 8492 T483 C60 P35429 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 8493 T392 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 8494 T483 C60 P35429 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:46241/solr/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 8494 T392 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 8494 T483 C60 P35429 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:35429/solr START replicas=[http://127.0.0.1:46241/solr/collection1/] nUpdates=100
[junit4:junit4]   2> 8495 T483 C60 P35429 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 8495 T392 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 8495 T483 C60 P35429 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 8496 T483 C60 P35429 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 8496 T483 C60 P35429 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 8497 T427 C58 P46241 REQ /get {version=2&getVersions=100&qt=/get&wt=javabin&distrib=false} status=0 QTime=0 
[junit4:junit4]   2> 8501 T392 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:36143/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@40846925
[junit4:junit4]   2> 8503 T485 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:36143. Will not attempt to authenticate using SASL (Access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 8502 T392 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 8503 T485 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:36143, initiating session
[junit4:junit4]   2> 8503 T394 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:43586
[junit4:junit4]   2> 8504 T394 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:43586
[junit4:junit4]   2> 8505 T396 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8f932c8e000c with negotiated timeout 10000 for client /127.0.0.1:43586
[junit4:junit4]   2> 8505 T485 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:36143, sessionid = 0x13b8f932c8e000c, negotiated timeout = 10000
[junit4:junit4]   2> 8505 T486 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@40846925 name:ZooKeeperConnection Watcher:127.0.0.1:36143/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 8506 T392 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 8507 T392 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 8510 T392 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 8510 T392 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 8515 T392 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8517 T392 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4]   2> 8518 T392 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4]   2> 8519 T392 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2>  C57_STATE=coll:collection1 core:collection1 props:{base_url=http://127.0.0.1:39965/solr, state=recovering, node_name=127.0.0.1:39965_solr, roles=null, collection=collection1, shard=shard1, core=collection1}
[junit4:junit4]   2> 8706 T449 C57 P39965 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 8706 T449 C57 P39965 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 8706 T449 C57 P39965 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:46241/solr/collection1/. core=collection1
[junit4:junit4]   2> 8706 T449 C57 P39965 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 8713 T427 C58 P46241 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16
[junit4:junit4]   2> 8716 T427 C58 P46241 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 8718 T427 C58 P46241 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1355323485284/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@dd9da2ee),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 8718 T427 C58 P46241 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 8795 T427 C58 P46241 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1355323485284/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@dd9da2ee),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1355323485284/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@dd9da2ee),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 8795 T427 C58 P46241 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 8796 T427 C58 P46241 oass.SolrIndexSearcher.<init> Opening Searcher@9c2102e8 realtime
[junit4:junit4]   2> 8797 T427 C58 P46241 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 8797 T427 C58 P46241 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 8798 T427 C58 P46241 /update {softCommit=false&commit_end_point=true&commit=true&version=2&waitSearcher=true&wt=javabin&openSearcher=false} {commit=} 0 87
[junit4:junit4]   2> 8807 T449 C57 P39965 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 8807 T449 C57 P39965 oascsi.HttpClientUtil.createClient Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
[junit4:junit4]   2> 8811 T415 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8812 T449 C57 P39965 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 8812 T415 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:35429/solr",
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:35429_solr",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "core":"collection1"}
[junit4:junit4]   2> 8815 T426 C58 P46241 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 8815 T426 C58 P46241 REQ /replication {version=2&command=indexversion&qt=/replication&wt=javabin} status=0 QTime=2 
[junit4:junit4]   2> 8816 T449 C57 P39965 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 8817 T449 C57 P39965 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 8817 T449 C57 P39965 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 8818 T486 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8818 T431 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8818 T414 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8818 T446 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8819 T463 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8819 T480 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8822 T427 C58 P46241 REQ /replication {generation=2&version=2&command=filelist&qt=/replication&wt=javabin} status=0 QTime=2 
[junit4:junit4]   2> 8823 T449 C57 P39965 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 8824 T449 C57 P39965 oash.SnapPuller.fetchLatestIndex Starting download to ./org.apache.solr.cloud.SyncSliceTest-1355323485284/jetty2/index.20121212114454102 fullCopy=true
[junit4:junit4]   2> 8828 T424 C58 P46241 REQ /replication {qt=/replication&checksum=true&generation=2&command=filecontent&file=segments_2&wt=filestream} status=0 QTime=1 
[junit4:junit4]   2> 8832 T449 C57 P39965 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 8832 T449 C57 P39965 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20121212114454102
[junit4:junit4]   2> 8858 T449 C57 P39965 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.SyncSliceTest-1355323485284/jetty2/index/ new=./org.apache.solr.cloud.SyncSliceTest-1355323485284/jetty2/index.20121212114454102
[junit4:junit4]   2> 8859 T449 C57 P39965 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1355323485284/jetty2/index.20121212114454102 forceNew:false
[junit4:junit4]   2> 8861 T449 C57 P39965 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1355323485284/jetty2/index.20121212114454102 lockFactory=org.apache.lucene.store.NativeFSLockFactory@e8dadacd),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 8861 T449 C57 P39965 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 8863 T449 C57 P39965 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 8863 T449 C57 P39965 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 8864 T449 C57 P39965 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4]   2> 8864 T449 C57 P39965 oasc.CachingDirectoryFactory.close Closing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1355323485284/jetty2/index.20121212114454102
[junit4:junit4]   2> 8865 T449 C57 P39965 oash.SnapPuller$2.onClose removing old index directory ./org.apache.solr.cloud.SyncSliceTest-1355323485284/jetty2/index
[junit4:junit4]   2> 8866 T449 C57 P39965 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1355323485284/jetty2/index.20121212114454102 forceNew:true
[junit4:junit4]   2> 8867 T449 C57 P39965 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1355323485284/jetty2/index.20121212114454102 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7dd93d6d),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 8868 T449 C57 P39965 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 8868 T449 C57 P39965 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 8869 T449 C57 P39965 oass.SolrIndexSearcher.<init> Opening Searcher@cb4d6fe9 main
[junit4:junit4]   2> 8869 T449 C57 P39965 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 8871 T448 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@cb4d6fe9 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 8871 T449 C57 P39965 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 8886 T449 C57 P39965 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1355323485284/jetty2/index.20121212114454102 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7dd93d6d),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1355323485284/jetty2/index.20121212114454102 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7dd93d6d),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 8886 T449 C57 P39965 oasc.SolrDeletionPolicy.updateCommits newest commit = 3
[junit4:junit4]   2> 8887 T449 C57 P39965 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 8887 T449 C57 P39965 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 8888 T449 C57 P39965 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 8888 T449 C57 P39965 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 8888 T449 C57 P39965 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 8891 T449 C57 P39965 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 9324 T415 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9325 T415 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:39965/solr",
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:39965_solr",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "core":"collection1"}
[junit4:junit4]   2> 9330 T431 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9330 T486 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9330 T414 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9330 T446 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9330 T463 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9330 T480 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9522 T392 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2>  C59_STATE=coll:collection1 core:collection1 props:{base_url=http://127.0.0.1:48563/solr, state=recovering, node_name=127.0.0.1:48563_solr, roles=null, collection=collection1, shard=shard1, core=collection1}
[junit4:junit4]   2> 10126 T466 C59 P48563 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 10127 T466 C59 P48563 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 10127 T466 C59 P48563 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:46241/solr/collection1/. core=collection1
[junit4:junit4]   2> 10128 T466 C59 P48563 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 10137 T424 C58 P46241 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 10145 T424 C58 P46241 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1355323485284/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@dd9da2ee),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1355323485284/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@dd9da2ee),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 10146 T424 C58 P46241 oasc.SolrDeletionPolicy.updateCommits newest commit = 3
[junit4:junit4]   2> 10147 T424 C58 P46241 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 10148 T424 C58 P46241 /update {softCommit=false&commit_end_point=true&commit=true&version=2&waitSearcher=true&wt=javabin&openSearcher=false} {commit=} 0 11
[junit4:junit4]   2> 10150 T466 C59 P48563 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 10150 T466 C59 P48563 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 10154 T427 C58 P46241 REQ /replication {version=2&command=indexversion&qt=/replication&wt=javabin} status=0 QTime=1 
[junit4:junit4]   2> 10155 T466 C59 P48563 oash.SnapPuller.fetchLatestIndex Master's generation: 3
[junit4:junit4]   2> 10156 T466 C59 P48563 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 10156 T466 C59 P48563 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 10159 T425 C58 P46241 REQ /replication {generation=3&version=2&command=filelist&qt=/replication&wt=javabin} status=0 QTime=0 
[junit4:junit4]   2> 10161 T466 C59 P48563 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 10163 T466 C59 P48563 oash.SnapPuller.fetchLatestIndex Starting download to ./org.apache.solr.cloud.SyncSliceTest-1355323485284/jetty3/index.20121212114455441 fullCopy=true
[junit4:junit4]   2> 10166 T424 C58 P46241 REQ /replication {qt=/replication&checksum=true&generation=3&command=filecontent&file=segments_3&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 10169 T466 C59 P48563 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 10171 T466 C59 P48563 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20121212114455441
[junit4:junit4]   2> 10172 T466 C59 P48563 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.SyncSliceTest-1355323485284/jetty3/index/ new=./org.apache.solr.cloud.SyncSliceTest-1355323485284/jetty3/index.20121212114455441
[junit4:junit4]   2> 10173 T466 C59 P48563 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1355323485284/jetty3/index.20121212114455441 forceNew:false
[junit4:junit4]   2> 10175 T466 C59 P48563 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1355323485284/jetty3/index.20121212114455441 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7409981),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 10175 T466 C59 P48563 oasc.SolrDeletionPolicy.updateCommits newest commit = 3
[junit4:junit4]   2> 10177 T466 C59 P48563 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 10177 T466 C59 P48563 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 10178 T466 C59 P48563 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4]   2> 10178 T466 C59 P48563 oasc.CachingDirectoryFactory.close Closing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1355323485284/jetty3/index.20121212114455441
[junit4:junit4]   2> 10179 T466 C59 P48563 oash.SnapPuller$2.onClose removing old index directory ./org.apache.solr.cloud.SyncSliceTest-1355323485284/jetty3/index
[junit4:junit4]   2> 10181 T466 C59 P48563 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1355323485284/jetty3/index.20121212114455441 forceNew:true
[junit4:junit4]   2> 10183 T466 C59 P48563 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1355323485284/jetty3/index.20121212114455441 lockFactory=org.apache.lucene.store.NativeFSLockFactory@c7a749d9),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 10183 T466 C59 P48563 oasc.SolrDeletionPolicy.updateCommits newest commit = 3
[junit4:junit4]   2> 10184 T466 C59 P48563 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 10185 T466 C59 P48563 oass.SolrIndexSearcher.<init> Opening Searcher@c01dfa7b main
[junit4:junit4]   2> 10185 T466 C59 P48563 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 10188 T465 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@c01dfa7b main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4]   2> 10189 T466 C59 P48563 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 10216 T466 C59 P48563 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1355323485284/jetty3/index.20121212114455441 lockFactory=org.apache.lucene.store.NativeFSLockFactory@c7a749d9),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1355323485284/jetty3/index.20121212114455441 lockFactory=org.apache.lucene.store.NativeFSLockFactory@c7a749d9),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4]   2> 10217 T466 C59 P48563 oasc.SolrDeletionPolicy.updateCommits newest commit = 4
[junit4:junit4]   2> 10218 T466 C59 P48563 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 10219 T466 C59 P48563 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 10219 T466 C59 P48563 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 10219 T466 C59 P48563 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 10220 T466 C59 P48563 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 10222 T466 C59 P48563 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 10341 T415 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10344 T415 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:48563/solr",
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:48563_solr",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "core":"collection1"}
[junit4:junit4]   2> 10352 T431 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10352 T486 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10352 T446 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10352 T480 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10352 T414 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10352 T463 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10525 T392 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2>  C60_STATE=coll:collection1 core:collection1 props:{base_url=http://127.0.0.1:35429/solr, state=recovering, node_name=127.0.0.1:35429_solr, roles=null, collection=collection1, shard=shard1, core=collection1}
[junit4:junit4]   2> 11502 T483 C60 P35429 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 11503 T483 C60 P35429 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 11503 T483 C60 P35429 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:46241/solr/collection1/. core=collection1
[junit4:junit4]   2> 11504 T483 C60 P35429 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 11510 T426 C58 P46241 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 11515 T426 C58 P46241 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=3
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1355323485284/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@dd9da2ee),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1355323485284/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@dd9da2ee),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1355323485284/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@dd9da2ee),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4]   2> 11516 T426 C58 P46241 oasc.SolrDeletionPolicy.updateCommits newest commit = 4
[junit4:junit4]   2> 11517 T426 C58 P46241 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 11518 T426 C58 P46241 /update {softCommit=false&commit_end_point=true&commit=true&version=2&waitSearcher=true&wt=javabin&openSearcher=false} {commit=} 0 8
[junit4:junit4]   2> 11520 T483 C60 P35429 oash.ReplicationHandler.inform Co

[...truncated too long message...]

pTeardownChained.java:50)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:780)
[junit4:junit4]   2> 568829 T2848 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> NOTE: test params are: codec=Lucene41: {multiDefault=PostingsFormat(name=NestedPulsing), other_tl1=PostingsFormat(name=TestBloomFilteredLucene41Postings), n_ti1=PostingsFormat(name=Memory doPackFST= false), rnd_b=PostingsFormat(name=Memory doPackFST= false), SubjectTerms_mfacet=PostingsFormat(name=TestBloomFilteredLucene41Postings), n_dt1=PostingsFormat(name=NestedPulsing), intDefault=PostingsFormat(name=TestBloomFilteredLucene41Postings), a_t=PostingsFormat(name=TestBloomFilteredLucene41Postings), timestamp=PostingsFormat(name=TestBloomFilteredLucene41Postings), id=PostingsFormat(name=Memory doPackFST= false), n_tdt1=PostingsFormat(name=TestBloomFilteredLucene41Postings), range_facet_si=PostingsFormat(name=NestedPulsing), range_facet_l=PostingsFormat(name=TestBloomFilteredLucene41Postings), range_facet_sl=MockFixedIntBlock(blockSize=371), _version_=PostingsFormat(name=TestBloomFilteredLucene41Postings), n_tl1=PostingsFormat(name=NestedPulsing), foo_b=MockFixedIntBlock(blockSize=371), foo_d=PostingsFormat(name=Memory doPackFST= false), foo_f=MockFixedIntBlock(blockSize=371), text=MockFixedIntBlock(blockSize=371), n_tf1=PostingsFormat(name=TestBloomFilteredLucene41Postings), n_td1=PostingsFormat(name=NestedPulsing), a_si=PostingsFormat(name=NestedPulsing), n_l1=PostingsFormat(name=TestBloomFilteredLucene41Postings), n_f1=PostingsFormat(name=NestedPulsing), n_d1=PostingsFormat(name=TestBloomFilteredLucene41Postings), oddField_s=MockFixedIntBlock(blockSize=371)}, sim=RandomSimilarityProvider(queryNorm=false,coord=crazy): {}, locale=ml_IN, timezone=Asia/Aden
[junit4:junit4]   2> NOTE: Linux 3.2.0-34-generic x86/IBM Corporation 1.7.0 (32-bit)/cpus=8,threads=2,free=116647728,total=285933568
[junit4:junit4]   2> NOTE: All tests run in this JVM: [TestDFRSimilarityFactory, TestOmitPositions, IndexSchemaRuntimeFieldTest, RecoveryZkTest, XmlUpdateRequestHandlerTest, TestMultiCoreConfBootstrap, DirectUpdateHandlerTest, TestReversedWildcardFilterFactory, IndexReaderFactoryTest, ScriptEngineTest, TestWriterPerf, SolrInfoMBeanTest, TestCodecSupport, TestCSVLoader, URLClassifyProcessorTest, RequiredFieldsTest, TestReplicationHandler, StatelessScriptUpdateProcessorFactoryTest, BadIndexSchemaTest, ReturnFieldsTest, ClusterStateUpdateTest, TestDocSet, TestFastWriter, TestValueSourceCache, TestQuerySenderListener, DisMaxRequestHandlerTest, TestDistributedSearch, TestRemoteStreaming, SolrIndexConfigTest, SolrCoreTest, TestStressLucene, ConvertedLegacyTest, TestPluginEnable, SuggesterTest, TestFunctionQuery, TestBinaryField, TestAtomicUpdateErrorCases, TestSort, SignatureUpdateProcessorFactoryTest, TestDistributedGrouping, ZkSolrClientTest, ClusterStateTest, HighlighterTest, OverseerCollectionProcessorTest, DebugComponentTest, DistributedQueryElevationComponentTest, LeaderElectionTest, OutputWriterTest, EchoParamsTest, FullSolrCloudDistribCmdsTest, BasicZkTest, SuggesterTSTTest, SpellingQueryConverterTest, PingRequestHandlerTest, UpdateParamsTest, DirectSolrSpellCheckerTest, RAMDirectoryFactoryTest, OverseerTest, SpellCheckComponentTest, LeaderElectionIntegrationTest, TestRealTimeGet, ZkControllerTest, TestRandomFaceting, SpellCheckCollatorTest, SoftAutoCommitTest, AutoCommitTest, TestFaceting, WordBreakSolrSpellCheckerTest, TestHashPartitioner, StatsComponentTest, TestRecovery, IndexBasedSpellCheckerTest, SimpleFacetsTest, TestCoreContainer, LukeRequestHandlerTest, TestFiltering, FileBasedSpellCheckerTest, PeerSyncTest, SortByFunctionTest, BasicFunctionalityTest, TestJmxIntegration, TestIndexSearcher, TestTrie, SolrRequestParserTest, CacheHeaderTest, QueryEqualityTest, PolyFieldTest, TestCSVResponseWriter, MoreLikeThisHandlerTest, DocumentBuilderTest, CurrencyFieldTest, IndexSchemaTest, BinaryUpdateRequestHandlerTest, QueryParsingTest, TermsComponentTest, XsltUpdateRequestHandlerTest, MinimalSchemaTest, StandardRequestHandlerTest, TestPHPSerializedResponseWriter, FieldAnalysisRequestHandlerTest, TermVectorComponentTest, TestSurroundQueryParser, DocumentAnalysisRequestHandlerTest, FastVectorHighlighterTest, JSONWriterTest, SearchHandlerTest, CopyFieldTest, TestArbitraryIndexDir, TestQueryUtils, LoggingHandlerTest, SolrCmdDistributorTest, UniqFieldsUpdateProcessorFactoryTest, CSVRequestHandlerTest, ShowFileRequestHandlerTest, TestSearchPerf, TestFoldingMultitermQuery, SolrCoreCheckLockOnStartupTest, TestSolrDeletionPolicy1, TestLuceneMatchVersion, TestPropInject, TestIndexingPerformance, NoCacheHeaderTest, PrimitiveFieldTypeTest, FieldMutatingUpdateProcessorTest, TestUpdate, TestSolrDeletionPolicy2, TestPropInjectDefaults, TestMergePolicyConfig, TestCollationField, TestQuerySenderNoQuery, NumericFieldsTest, TestNumberUtils, MultiTermTest, TestSolrCoreProperties, TestJmxMonitoredMap, TestConfig, TestBM25SimilarityFactory, TestPhraseSuggestions, TestPerFieldSimilarity, LegacyHTMLStripCharFilterTest, TimeZoneUtilsTest, DateMathParserTest, PrimUtilsTest, OpenExchangeRatesOrgProviderTest, FileUtilsTest, TestSystemIdResolver, TestSolrXMLSerializer, TestBadConfig, DOMUtilTest, TestLRUCache, UUIDFieldTest, TestUtils, ZkNodePropsTest, TestDocumentBuilder, TestCollationKeyRangeQueries, BasicDistributedZk2Test]
[junit4:junit4] Completed on J1 in 568.86s, 1 test, 1 failure <<< FAILURES!

[...truncated 12 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:365: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:178: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:438: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1175: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:839: There were test failures: 239 suites, 994 tests, 1 error, 2 failures, 7 ignored (2 assumptions)

Total time: 39 minutes 2 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 32bit/ibm-j9-jdk7 
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-4.x-Linux (32bit/jrockit-jdk1.6.0_33-R28.2.4-4.1.0) - Build # 3183 - Still Failing!

Posted by Policeman Jenkins Server <je...@sd-datasolutions.de>.
Build: http://jenkins.sd-datasolutions.de/job/Lucene-Solr-4.x-Linux/3183/
Java: 32bit/jrockit-jdk1.6.0_33-R28.2.4-4.1.0 -XnoOpt

2 tests failed.
FAILED:  org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch

Error Message:
There are still nodes recoverying - waited for 540 seconds

Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 540 seconds
	at __randomizedtesting.SeedInfo.seed([7A742FE34F0A21F3:FB92A1FB385541CF]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:165)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:115)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:110)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:563)
	at org.apache.solr.cloud.BasicDistributedZk2Test.brindDownShardIndexSomeDocsAndRecover(BasicDistributedZk2Test.java:321)
	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:83)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:738)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:774)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:683)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:44)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:56)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:662)


FAILED:  org.apache.solr.cloud.BasicDistributedZkTest.testDistribSearch

Error Message:
Server at http://127.0.0.1:53762/solr returned non ok status:500, message:Server Error

Stack Trace:
org.apache.solr.common.SolrException: Server at http://127.0.0.1:53762/solr returned non ok status:500, message:Server Error
	at __randomizedtesting.SeedInfo.seed([7A742FE34F0A21F3:FB92A1FB385541CF]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:372)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
	at org.apache.solr.client.solrj.request.CoreAdminRequest.process(CoreAdminRequest.java:429)
	at org.apache.solr.client.solrj.request.CoreAdminRequest.getStatus(CoreAdminRequest.java:472)
	at org.apache.solr.cloud.BasicDistributedZkTest.collectStartTimes(BasicDistributedZkTest.java:959)
	at org.apache.solr.cloud.BasicDistributedZkTest.testCollectionsAPI(BasicDistributedZkTest.java:795)
	at org.apache.solr.cloud.BasicDistributedZkTest.doTest(BasicDistributedZkTest.java:344)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:738)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:774)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:683)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:44)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:56)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:662)




Build Log:
[...truncated 8017 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZk2Test
[junit4:junit4]   2> 18 T339 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1355318805943
[junit4:junit4]   2> 19 T339 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 19 T340 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 20 T340 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 20 T340 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4]   2> 20 T340 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4]   2> 21 T340 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 21 T340 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1355318805943/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4]   2> 121 T339 oasc.ZkTestServer.run start zk server on port:38624
[junit4:junit4]   2> 122 T339 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:38624 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1b0feb09
[junit4:junit4]   2> 127 T345 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:38624. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 127 T339 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 127 T345 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:38624, initiating session
[junit4:junit4]   2> 128 T341 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:56863
[junit4:junit4]   2> 128 T341 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:56863
[junit4:junit4]   2> 128 T343 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 253 T343 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8f4bc5bb0000 with negotiated timeout 10000 for client /127.0.0.1:56863
[junit4:junit4]   2> 253 T345 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:38624, sessionid = 0x13b8f4bc5bb0000, negotiated timeout = 10000
[junit4:junit4]   2> 253 T346 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b0feb09 name:ZooKeeperConnection Watcher:127.0.0.1:38624 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 254 T339 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 254 T339 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 256 T344 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8f4bc5bb0000
[junit4:junit4]   2> 257 T346 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 257 T341 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:56863 which had sessionid 0x13b8f4bc5bb0000
[junit4:junit4]   2> 257 T339 oaz.ZooKeeper.close Session: 0x13b8f4bc5bb0000 closed
[junit4:junit4]   2> 257 T339 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:38624/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1b10815d
[junit4:junit4]   2> 258 T339 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 258 T347 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:38624. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 258 T347 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:38624, initiating session
[junit4:junit4]   2> 259 T341 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:56864
[junit4:junit4]   2> 259 T341 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:56864
[junit4:junit4]   2> 259 T343 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8f4bc5bb0001 with negotiated timeout 10000 for client /127.0.0.1:56864
[junit4:junit4]   2> 259 T347 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:38624, sessionid = 0x13b8f4bc5bb0001, negotiated timeout = 10000
[junit4:junit4]   2> 260 T348 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b10815d name:ZooKeeperConnection Watcher:127.0.0.1:38624/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 260 T339 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 260 T339 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 263 T339 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 266 T339 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 267 T339 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 268 T339 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 269 T339 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 272 T339 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 273 T339 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 275 T339 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 276 T339 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 278 T339 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 278 T339 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 280 T339 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 281 T339 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 282 T339 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 283 T339 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 284 T339 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 285 T339 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 286 T339 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 287 T339 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 289 T339 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 289 T339 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 291 T339 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 291 T339 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 293 T344 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8f4bc5bb0001
[junit4:junit4]   2> 293 T348 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 293 T341 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:56864 which had sessionid 0x13b8f4bc5bb0001
[junit4:junit4]   2> 293 T339 oaz.ZooKeeper.close Session: 0x13b8f4bc5bb0001 closed
[junit4:junit4]   2> 349 T339 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 352 T339 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:35281
[junit4:junit4]   2> 352 T339 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 353 T339 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1355318806219
[junit4:junit4]   2> 353 T339 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1355318806219/'
[junit4:junit4]   2> 367 T339 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 367 T339 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 368 T339 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1355318806219
[junit4:junit4]   2> 368 T339 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1355318806219/solr.xml
[junit4:junit4]   2> 368 T339 oasc.CoreContainer.<init> New CoreContainer 458263267
[junit4:junit4]   2> 369 T339 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1355318806219/'
[junit4:junit4]   2> 369 T339 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1355318806219/'
[junit4:junit4]   2> 384 T339 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 398 T339 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:38624/solr
[junit4:junit4]   2> 398 T339 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 399 T339 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:38624 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1b63b76c
[junit4:junit4]   2> 399 T339 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 400 T358 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:38624. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 400 T358 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:38624, initiating session
[junit4:junit4]   2> 400 T341 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:56865
[junit4:junit4]   2> 401 T341 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:56865
[junit4:junit4]   2> 402 T343 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8f4bc5bb0002 with negotiated timeout 20000 for client /127.0.0.1:56865
[junit4:junit4]   2> 402 T358 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:38624, sessionid = 0x13b8f4bc5bb0002, negotiated timeout = 20000
[junit4:junit4]   2> 402 T359 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b63b76c name:ZooKeeperConnection Watcher:127.0.0.1:38624 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 403 T339 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 404 T344 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8f4bc5bb0002
[junit4:junit4]   2> 404 T341 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:56865 which had sessionid 0x13b8f4bc5bb0002
[junit4:junit4]   2> 404 T339 oaz.ZooKeeper.close Session: 0x13b8f4bc5bb0002 closed
[junit4:junit4]   2> 404 T359 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 404 T339 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:38624/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@1b5ffcb4
[junit4:junit4]   2> 405 T360 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:38624. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 405 T339 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 406 T341 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:56866
[junit4:junit4]   2> 406 T360 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:38624, initiating session
[junit4:junit4]   2> 406 T341 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:56866
[junit4:junit4]   2> 407 T343 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8f4bc5bb0003 with negotiated timeout 8000 for client /127.0.0.1:56866
[junit4:junit4]   2> 407 T360 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:38624, sessionid = 0x13b8f4bc5bb0003, negotiated timeout = 8000
[junit4:junit4]   2> 407 T361 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b5ffcb4 name:ZooKeeperConnection Watcher:127.0.0.1:38624/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 407 T339 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 408 T344 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f4bc5bb0003 type:create cxid:0x2 zxid:0x1b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 409 T339 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 410 T339 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35281_solr
[junit4:junit4]   2> 411 T344 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f4bc5bb0003 type:delete cxid:0x7 zxid:0x1d txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:35281_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:35281_solr
[junit4:junit4]   2> 412 T339 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:35281_solr
[junit4:junit4]   2> 414 T339 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 414 T339 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 415 T339 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 415 T339 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 416 T339 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 416 T339 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 417 T339 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 417 T339 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 417 T339 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 418 T339 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 422 T339 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 425 T344 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f4bc5bb0003 type:delete cxid:0x15 zxid:0x22 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 426 T339 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 427 T339 oasc.Overseer.start Overseer (id=88822173266542595-127.0.0.1:35281_solr-n_0000000000) starting
[junit4:junit4]   2> 428 T344 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f4bc5bb0003 type:create cxid:0x1a zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 428 T344 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f4bc5bb0003 type:create cxid:0x1b zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 429 T344 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f4bc5bb0003 type:create cxid:0x1c zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 430 T344 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f4bc5bb0003 type:create cxid:0x1d zxid:0x27 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 430 T363 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
[junit4:junit4]   2> 431 T339 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 433 T339 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 438 T362 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 439 T364 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1355318806219/collection1
[junit4:junit4]   2> 439 T364 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4]   2> 440 T364 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 440 T364 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4]   2> 441 T364 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1355318806219/collection1/'
[junit4:junit4]   2> 441 T364 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1355318806219/collection1/lib/README' to classloader
[junit4:junit4]   2> 442 T364 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1355318806219/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 491 T364 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 550 T364 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 551 T364 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 556 T364 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 1084 T364 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 1095 T364 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 1099 T364 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 1108 T364 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1111 T364 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1115 T364 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1116 T364 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1117 T364 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1355318806219/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1355318805943/control/data/
[junit4:junit4]   2> 1117 T364 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1ad38771
[junit4:junit4]   2> 1117 T364 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1355318805943/control/data/index/
[junit4:junit4]   2> 1118 T364 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1355318805943/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 1118 T364 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1355318805943/control/data/index forceNew:false
[junit4:junit4]   2> 1121 T364 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1355318805943/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1af08c29; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 1122 T364 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 1122 T364 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 1123 T364 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 1124 T364 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 1124 T364 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 1124 T364 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 1125 T364 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 1125 T364 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 1125 T364 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 1126 T364 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 1126 T364 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 1127 T364 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 1128 T364 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 1128 T364 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 1129 T364 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 1129 T364 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 1129 T364 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 1130 T364 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 1131 T364 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1131 T364 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1132 T364 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1132 T364 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1133 T364 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1134 T364 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1134 T364 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1135 T364 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 1136 T364 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 1138 T364 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 1140 T364 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 1141 T364 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 1144 T364 oass.SolrIndexSearcher.<init> Opening Searcher@1b037ca1 main
[junit4:junit4]   2> 1144 T364 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 1144 T364 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 1144 T364 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 1145 T364 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 1149 T364 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 1177 T365 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1b037ca1 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 1183 T364 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 1183 T364 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 1184 T344 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f4bc5bb0003 type:create cxid:0x53 zxid:0x2a txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 1185 T364 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 1185 T364 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:35281/solr shardId:control_shard
[junit4:junit4]   2> 1186 T364 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/control_shard/election
[junit4:junit4]   2> 1191 T344 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f4bc5bb0003 type:delete cxid:0x62 zxid:0x31 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4]   2> 1192 T364 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 1192 T344 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f4bc5bb0003 type:create cxid:0x63 zxid:0x32 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1441 T362 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 1442 T362 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":"control_shard",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:35281_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:35281/solr"}
[junit4:junit4]   2> 1442 T344 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f4bc5bb0003 type:create cxid:0x6a zxid:0x34 txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 1447 T361 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 1694 T364 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 1694 T364 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 1694 T364 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:35281/solr/collection1/
[junit4:junit4]   2> 1694 T364 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 1695 T364 oasc.SyncStrategy.syncToMe http://127.0.0.1:35281/solr/collection1/ has no replicas
[junit4:junit4]   2> 1695 T364 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:35281/solr/collection1/
[junit4:junit4]   2> 1695 T364 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/control_shard
[junit4:junit4]   2> 1698 T344 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f4bc5bb0003 type:create cxid:0x89 zxid:0x3f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1951 T362 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 1953 T361 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 2000 T364 oasc.ZkController.register We are http://127.0.0.1:35281/solr/collection1/ and leader is http://127.0.0.1:35281/solr/collection1/
[junit4:junit4]   2> 2001 T364 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:35281/solr
[junit4:junit4]   2> 2001 T364 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 2001 T364 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 2002 T364 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 2003 T364 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2003 T339 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   2> 2004 T339 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 2004 T339 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 2061 T339 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 2063 T339 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:43182
[junit4:junit4]   2> 2063 T339 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 2064 T339 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty1-1355318807932
[junit4:junit4]   2> 2064 T339 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty1-1355318807932/'
[junit4:junit4]   2> 2079 T339 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 2080 T339 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 2080 T339 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty1-1355318807932
[junit4:junit4]   2> 2080 T339 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty1-1355318807932/solr.xml
[junit4:junit4]   2> 2081 T339 oasc.CoreContainer.<init> New CoreContainer 455520935
[junit4:junit4]   2> 2081 T339 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty1-1355318807932/'
[junit4:junit4]   2> 2081 T339 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty1-1355318807932/'
[junit4:junit4]   2> 2097 T339 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 2111 T339 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:38624/solr
[junit4:junit4]   2> 2111 T339 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 2112 T339 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:38624 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1b9bc10c
[junit4:junit4]   2> 2112 T339 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2113 T375 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:38624. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 2113 T375 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:38624, initiating session
[junit4:junit4]   2> 2113 T341 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:56867
[junit4:junit4]   2> 2114 T341 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:56867
[junit4:junit4]   2> 2114 T343 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8f4bc5bb0004 with negotiated timeout 20000 for client /127.0.0.1:56867
[junit4:junit4]   2> 2114 T375 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:38624, sessionid = 0x13b8f4bc5bb0004, negotiated timeout = 20000
[junit4:junit4]   2> 2114 T376 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b9bc10c name:ZooKeeperConnection Watcher:127.0.0.1:38624 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2115 T339 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2115 T344 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8f4bc5bb0004
[junit4:junit4]   2> 2116 T341 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:56867 which had sessionid 0x13b8f4bc5bb0004
[junit4:junit4]   2> 2116 T376 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 2116 T339 oaz.ZooKeeper.close Session: 0x13b8f4bc5bb0004 closed
[junit4:junit4]   2> 2116 T339 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:38624/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@1b9c57a0
[junit4:junit4]   2> 2117 T377 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:38624. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 2117 T339 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2118 T377 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:38624, initiating session
[junit4:junit4]   2> 2119 T341 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:56868
[junit4:junit4]   2> 2119 T341 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:56868
[junit4:junit4]   2> 2120 T343 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8f4bc5bb0005 with negotiated timeout 8000 for client /127.0.0.1:56868
[junit4:junit4]   2> 2120 T377 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:38624, sessionid = 0x13b8f4bc5bb0005, negotiated timeout = 8000
[junit4:junit4]   2> 2120 T378 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b9c57a0 name:ZooKeeperConnection Watcher:127.0.0.1:38624/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2120 T339 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2121 T344 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f4bc5bb0005 type:create cxid:0x1 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2122 T344 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f4bc5bb0005 type:create cxid:0x2 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2124 T339 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43182_solr
[junit4:junit4]   2> 2125 T344 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f4bc5bb0005 type:delete cxid:0x4 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:43182_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:43182_solr
[junit4:junit4]   2> 2126 T339 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:43182_solr
[junit4:junit4]   2> 2127 T361 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 2128 T339 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 2129 T361 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 2129 T339 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 2129 T339 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 2130 T339 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 2130 T339 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 2130 T339 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 2131 T339 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 2132 T339 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 2132 T339 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 2132 T339 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 2139 T339 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 2145 T379 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty1-1355318807932/collection1
[junit4:junit4]   2> 2146 T379 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 2146 T379 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 2146 T379 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 2147 T379 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty1-1355318807932/collection1/'
[junit4:junit4]   2> 2148 T379 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/solrtest-jetty1-1355318807932/collection1/lib/README' to classloader
[junit4:junit4]   2> 2148 T379 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/solrtest-jetty1-1355318807932/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 2189 T379 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 2251 T379 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 2252 T379 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 2258 T379 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 2456 T362 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2456 T362 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":"control_shard",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:35281_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:35281/solr"}
[junit4:junit4]   2> 2458 T378 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 2459 T361 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 2776 T379 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 2789 T379 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 2792 T379 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 2800 T379 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 2804 T379 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 2807 T379 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 2808 T379 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 2809 T379 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty1-1355318807932/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1355318805943/jetty1/
[junit4:junit4]   2> 2809 T379 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1ad38771
[junit4:junit4]   2> 2809 T379 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1355318805943/jetty1/index/
[junit4:junit4]   2> 2810 T379 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1355318805943/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 2810 T379 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1355318805943/jetty1/index forceNew:false
[junit4:junit4]   2> 2813 T379 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1355318805943/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1b0867dc; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 2814 T379 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 2815 T379 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 2816 T379 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 2816 T379 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 2816 T379 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 2817 T379 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 2818 T379 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 2818 T379 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 2818 T379 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 2819 T379 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 2820 T379 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 2821 T379 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 2822 T379 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 2822 T379 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 2823 T379 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 2823 T379 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 2824 T379 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 2825 T379 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 2825 T379 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2826 T379 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2827 T379 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2828 T379 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2829 T379 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2830 T379 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2830 T379 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2831 T379 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 2832 T379 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 2834 T379 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 2836 T379 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 2838 T379 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 2840 T379 oass.SolrIndexSearcher.<init> Opening Searcher@1b029cf2 main
[junit4:junit4]   2> 2840 T379 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 2840 T379 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 2841 T379 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 2841 T379 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 2845 T379 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 2876 T380 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1b029cf2 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 2882 T379 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 2883 T379 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 2961 T362 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2962 T362 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:43182_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:43182/solr"}
[junit4:junit4]   2> 2962 T362 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4]   2> 2963 T362 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 2965 T361 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 2965 T378 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3384 T379 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 3384 T379 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:43182/solr shardId:shard1
[junit4:junit4]   2> 3385 T379 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 3389 T344 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f4bc5bb0005 type:delete cxid:0x45 zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 3389 T379 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 3390 T344 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f4bc5bb0005 type:create cxid:0x46 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3391 T379 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 3391 T379 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 3391 T379 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:43182/solr/collection1/
[junit4:junit4]   2> 3391 T379 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 3391 T379 oasc.SyncStrategy.syncToMe http://127.0.0.1:43182/solr/collection1/ has no replicas
[junit4:junit4]   2> 3392 T379 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:43182/solr/collection1/
[junit4:junit4]   2> 3392 T379 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 3395 T344 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f4bc5bb0005 type:create cxid:0x50 zxid:0x60 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3468 T362 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3472 T361 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3472 T378 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3496 T379 oasc.ZkController.register We are http://127.0.0.1:43182/solr/collection1/ and leader is http://127.0.0.1:43182/solr/collection1/
[junit4:junit4]   2> 3497 T379 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:43182/solr
[junit4:junit4]   2> 3497 T379 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 3497 T379 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 3497 T379 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 3498 T379 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3499 T339 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   2> 3500 T339 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 3500 T339 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 3562 T339 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 3564 T339 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:50246
[junit4:junit4]   2> 3565 T339 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 3565 T339 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty2-1355318809428
[junit4:junit4]   2> 3565 T339 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty2-1355318809428/'
[junit4:junit4]   2> 3581 T339 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 3581 T339 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 3582 T339 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty2-1355318809428
[junit4:junit4]   2> 3582 T339 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty2-1355318809428/solr.xml
[junit4:junit4]   2> 3582 T339 oasc.CoreContainer.<init> New CoreContainer 455968067
[junit4:junit4]   2> 3583 T339 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty2-1355318809428/'
[junit4:junit4]   2> 3583 T339 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty2-1355318809428/'
[junit4:junit4]   2> 3599 T339 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 3613 T339 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:38624/solr
[junit4:junit4]   2> 3613 T339 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 3614 T339 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:38624 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1ba0fc95
[junit4:junit4]   2> 3615 T390 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:38624. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 3615 T339 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3615 T341 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:56869
[junit4:junit4]   2> 3615 T390 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:38624, initiating session
[junit4:junit4]   2> 3616 T341 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:56869
[junit4:junit4]   2> 3616 T343 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8f4bc5bb0006 with negotiated timeout 20000 for client /127.0.0.1:56869
[junit4:junit4]   2> 3616 T390 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:38624, sessionid = 0x13b8f4bc5bb0006, negotiated timeout = 20000
[junit4:junit4]   2> 3617 T391 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ba0fc95 name:ZooKeeperConnection Watcher:127.0.0.1:38624 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3617 T339 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3618 T344 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8f4bc5bb0006
[junit4:junit4]   2> 3618 T391 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 3618 T341 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:56869 which had sessionid 0x13b8f4bc5bb0006
[junit4:junit4]   2> 3618 T339 oaz.ZooKeeper.close Session: 0x13b8f4bc5bb0006 closed
[junit4:junit4]   2> 3619 T339 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:38624/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@1ba1533d
[junit4:junit4]   2> 3620 T392 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:38624. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 3619 T339 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3620 T392 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:38624, initiating session
[junit4:junit4]   2> 3620 T341 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:56870
[junit4:junit4]   2> 3620 T341 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:56870
[junit4:junit4]   2> 3621 T343 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8f4bc5bb0007 with negotiated timeout 8000 for client /127.0.0.1:56870
[junit4:junit4]   2> 3621 T392 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:38624, sessionid = 0x13b8f4bc5bb0007, negotiated timeout = 8000
[junit4:junit4]   2> 3621 T393 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ba1533d name:ZooKeeperConnection Watcher:127.0.0.1:38624/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3621 T339 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3622 T344 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f4bc5bb0007 type:create cxid:0x1 zxid:0x6d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3622 T344 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f4bc5bb0007 type:create cxid:0x2 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3623 T339 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50246_solr
[junit4:junit4]   2> 3623 T344 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f4bc5bb0007 type:delete cxid:0x4 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:50246_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:50246_solr
[junit4:junit4]   2> 3624 T339 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50246_solr
[junit4:junit4]   2> 3625 T361 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3625 T378 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 3625 T378 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 3625 T339 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 3626 T339 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 3626 T361 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 3626 T339 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 3627 T339 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 3627 T339 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 3627 T339 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 3628 T339 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 3628 T339 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 3628 T339 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 3629 T339 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 3633 T339 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3639 T394 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty2-1355318809428/collection1
[junit4:junit4]   2> 3639 T394 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 3640 T394 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 3640 T394 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 3641 T394 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty2-1355318809428/collection1/'
[junit4:junit4]   2> 3641 T394 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/solrtest-jetty2-1355318809428/collection1/lib/README' to classloader
[junit4:junit4]   2> 3641 T394 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/solrtest-jetty2-1355318809428/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 3680 T394 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 3748 T394 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 3749 T394 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 3755 T394 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 3975 T362 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3975 T362 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:43182_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:43182/solr"}
[junit4:junit4]   2> 3978 T361 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 3978 T378 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 3978 T393 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4279 T394 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 4287 T394 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 4291 T394 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 4299 T394 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 4303 T394 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 4306 T394 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 4307 T394 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 4308 T394 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty2-1355318809428/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1355318805943/jetty2/
[junit4:junit4]   2> 4308 T394 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1ad38771
[junit4:junit4]   2> 4309 T394 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1355318805943/jetty2/index/
[junit4:junit4]   2> 4309 T394 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1355318805943/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 4310 T394 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1355318805943/jetty2/index forceNew:false
[junit4:junit4]   2> 4313 T394 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1355318805943/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1af80167; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 4313 T394 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 4314 T394 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 4315 T394 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 4315 T394 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 4316 T394 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 4316 T394 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 4316 T394 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 4316 T394 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 4317 T394 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 4318 T394 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 4318 T394 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 4319 T394 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 4320 T394 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 4321 T394 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 4321 T394 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 4322 T394 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 4322 T394 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 4323 T394 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 4324 T394 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4324 T394 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4325 T394 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4326 T394 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4327 T394 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4328 T394 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4329 T394 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4330 T394 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 4330 T394 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 4333 T394 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 4335 T394 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 4336 T394 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 4338 T394 oass.SolrIndexSearcher.<init> Opening Searcher@1b14091e main
[junit4:junit4]   2> 4338 T394 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 4339 T394 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 4339 T394 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 4340 T394 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 4343 T394 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 4372 T395 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1b14091e main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 4379 T394 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 4379 T394 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 4481 T362 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4482 T362 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:50246_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:50246/solr"}
[junit4:junit4]   2> 4482 T362 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 4482 T362 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4]   2> 4485 T393 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4485 T378 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4485 T361 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4881 T394 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 4881 T394 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:50246/solr shardId:shard2
[junit4:junit4]   2> 4882 T394 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4]   2> 4885 T344 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f4bc5bb0007 type:delete cxid:0x44 zxid:0x7e txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard2 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard2
[junit4:junit4]   2> 4886 T394 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 4886 T344 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f4bc5bb0007 type:create cxid:0x45 zxid:0x7f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4887 T394 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 4887 T394 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 4887 T394 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:50246/solr/collection1/
[junit4:junit4]   2> 4888 T394 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 4888 T394 oasc.SyncStrategy.syncToMe http://127.0.0.1:50246/solr/collection1/ has no replicas
[junit4:junit4]   2> 4888 T394 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:50246/solr/collection1/
[junit4:junit4]   2> 4888 T394 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4]   2> 4890 T344 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f4bc5bb0007 type:create cxid:0x4e zxid:0x82 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4987 T362 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4994 T361 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4994 T378 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4994 T393 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5042 T394 oasc.ZkController.register We are http://127.0.0.1:50246/solr/collection1/ and leader is http://127.0.0.1:50246/solr/collection1/
[junit4:junit4]   2> 5042 T394 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:50246/solr
[junit4:junit4]   2> 5042 T394 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 5042 T394 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 5042 T394 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 5043 T394 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5044 T339 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   2> 5044 T339 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 5045 T339 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 5103 T339 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 5105 T339 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:38044
[junit4:junit4]   2> 5105 T339 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 5106 T339 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty3-1355318810973
[junit4:junit4]   2> 5106 T339 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty3-1355318810973/'
[junit4:junit4]   2> 5120 T339 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 5121 T339 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 5121 T339 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty3-1355318810973
[junit4:junit4]   2> 5121 T339 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty3-1355318810973/solr.xml
[junit4:junit4]   2> 5122 T339 oasc.CoreContainer.<init> New CoreContainer 456602038
[junit4:junit4]   2> 5122 T339 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty3-1355318810973/'
[junit4:junit4]   2> 5123 T339 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty3-1355318810973/'
[junit4:junit4]   2> 5137 T339 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 5151 T339 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:38624/solr
[junit4:junit4]   2> 5152 T339 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 5152 T339 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:38624 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1baa748d
[junit4:junit4]   2> 5153 T405 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:38624. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 5153 T339 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 5153 T341 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:56871
[junit4:junit4]   2> 5153 T405 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:38624, initiating session
[junit4:junit4]   2> 5154 T341 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:56871
[junit4:junit4]   2> 5154 T343 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8f4bc5bb0008 with negotiated timeout 20000 for client /127.0.0.1:56871
[junit4:junit4]   2> 5154 T405 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:38624, sessionid = 0x13b8f4bc5bb0008, negotiated timeout = 20000
[junit4:junit4]   2> 5155 T406 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1baa748d name:ZooKeeperConnection Watcher:127.0.0.1:38624 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 5155 T339 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 5156 T344 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8f4bc5bb0008
[junit4:junit4]   2> 5156 T406 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 5156 T339 oaz.ZooKeeper.close Session: 0x13b8f4bc5bb0008 closed
[junit4:junit4]   2> 5156 T341 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:56871 which had sessionid 0x13b8f4bc5bb0008
[junit4:junit4]   2> 5157 T339 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:38624/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@1baacb35
[junit4:junit4]   2> 5158 T407 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:38624. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 5158 T339 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 5158 T407 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:38624, initiating session
[junit4:junit4]   2> 5158 T341 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:56872
[junit4:junit4]   2> 5158 T341 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:56872
[junit4:junit4]   2> 5159 T343 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8f4bc5bb0009 with negotiated timeout 8000 for client /127.0.0.1:56872
[junit4:junit4]   2> 5159 T407 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:38624, sessionid = 0x13b8f4bc5bb0009, negotiated timeout = 8000
[junit4:junit4]   2> 5159 T408 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1baacb35 name:ZooKeeperConnection Watcher:127.0.0.1:38624/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 5159 T339 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 5160 T344 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f4bc5bb0009 type:create cxid:0x1 zxid:0x8f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5160 T344 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f4bc5bb0009 type:create cxid:0x2 zxid:0x90 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5161 T339 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38044_solr
[junit4:junit4]   2> 5161 T344 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f4bc5bb0009 type:delete cxid:0x4 zxid:0x91 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:38044_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:38044_solr
[junit4:junit4]   2> 5162 T339 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:38044_solr
[junit4:junit4]   2> 5163 T393 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5163 T361 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5163 T378 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 5164 T378 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5164 T393 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 5164 T339 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 5164 T361 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 5164 T339 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 5165 T339 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 5165 T339 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 5166 T339 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 5166 T339 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 5166 T339 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 5166 T339 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 5167 T339 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 5167 T339 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 5172 T339 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 5178 T409 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty3-1355318810973/collection1
[junit4:junit4]   2> 5178 T409 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 5178 T409 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 5178 T409 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 5179 T409 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty3-1355318810973/collection1/'
[junit4:junit4]   2> 5180 T409 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/solrtest-jetty3-1355318810973/collection1/lib/README' to classloader
[junit4:junit4]   2> 5180 T409 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/solrtest-jetty3-1355318810973/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 5219 T409 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 5280 T409 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 5281 T409 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 5287 T409 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 5497 T362 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5497 T362 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:50246_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:50246/solr"}
[junit4:junit4]   2> 5500 T393 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5500 T378 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5500 T408 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5500 T361 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5823 T409 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 5831 T409 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 5835 T409 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 5845 T409 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5848 T409 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5851 T409 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5852 T409 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5853 T409 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty3-1355318810973/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1355318805943/jetty3/
[junit4:junit4]   2> 5853 T409 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1ad38771
[junit4:junit4]   2> 5854 T409 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1355318805943/jetty3/index/
[junit4:junit4]   2> 5854 T409 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1355318805943/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 5855 T409 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1355318805943/jetty3/index forceNew:false
[junit4:junit4]   2> 5858 T409 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1355318805943/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1c2be90f; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 5858 T409 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 5859 T409 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 5860 T409 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 5860 T409 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 5860 T409 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 5861 T409 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 5861 T409 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 5861 T409 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 5862 T409 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 5863 T409 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 5864 T409 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 5864 T409 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 5865 T409 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 5866 T409 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 5867 T409 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 5867 T409 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 5867 T409 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 5868 T409 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 5869 T409 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5870 T409 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5871 T409 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5871 T409 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5872 T409 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5873 T409 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5874 T409 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5875 T409 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 5876 T409 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 5878 T409 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 5880 T409 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 5881 T409 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 5884 T409 oass.SolrIndexSearcher.<init> Opening Searcher@1c2e2265 main
[junit4:junit4]   2> 5884 T409 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 5885 T409 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 5885 T409 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 5885 T409 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 5889 T409 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 5919 T410 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1c2e2265 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 5926 T409 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 5926 T409 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 6003 T362 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6004 T362 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:38044_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:38044/solr"}
[junit4:junit4]   2> 6004 T362 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 6004 T362 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 6007 T393 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6007 T361 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6008 T408 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6008 T378 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6427 T409 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 6427 T409 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:38044/solr shardId:shard1
[junit4:junit4]   2> 6429 T409 oasc.ZkController.register We are http://127.0.0.1:38044/solr/collection1/ and leader is http://127.0.0.1:43182/solr/collection1/
[junit4:junit4]   2> 6429 T409 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:38044/solr
[junit4:junit4]   2> 6429 T409 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 6430 T409 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C14 name=collection1 org.apache.solr.core.SolrCore@1c2b9496 url=http://127.0.0.1:38044/solr/collection1 node=127.0.0.1:38044_solr
[junit4:junit4]   2> 6430 T411 C14 P38044 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 6430 T409 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6430 T411 C14 P38044 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 6431 T411 C14 P38044 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 6431 T411 C14 P38044 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 6431 T339 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   2> 6431 T339 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 6432 T411 C14 P38044 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:43182/solr/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 6432 T411 C14 P38044 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:38044/solr START replicas=[http://127.0.0.1:43182/solr/collection1/] nUpdates=100
[junit4:junit4]   2> 6432 T339 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 6432 T411 C14 P38044 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 6433 T411 C14 P38044 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 6433 T411 C14 P38044 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 6433 T411 C14 P38044 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C15 name=collection1 org.apache.solr.core.SolrCore@1b08134d url=http://127.0.0.1:43182/solr/collection1 node=127.0.0.1:43182_solr
[junit4:junit4]   2> 6440 T373 C15 P43182 REQ /get {distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=0 
[junit4:junit4]   2> 6495 T339 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 6497 T339 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:50707
[junit4:junit4]   2> 6497 T339 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 6497 T339 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty4-1355318812360
[junit4:junit4]   2> 6498 T339 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty4-1355318812360/'
[junit4:junit4]   2> 6510 T362 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6511 T362 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:38044_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:38044/solr"}
[junit4:junit4]   2> 6513 T393 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6513 T361 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6513 T378 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6513 T339 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 6513 T408 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6514 T339 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 6514 T339 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty4-1355318812360
[junit4:junit4]   2> 6515 T339 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty4-1355318812360/solr.xml
[junit4:junit4]   2> 6515 T339 oasc.CoreContainer.<init> New CoreContainer 474889255
[junit4:junit4]   2> 6516 T339 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty4-1355318812360/'
[junit4:junit4]   2> 6516 T339 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty4-1355318812360/'
[junit4:junit4]   2> 6531 T339 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 6545 T339 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:38624/solr
[junit4:junit4]   2> 6545 T339 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 6545 T339 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:38624 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1c458e10
[junit4:junit4]   2> 6546 T422 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:38624. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 6546 T339 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6547 T422 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:38624, initiating session
[junit4:junit4]   2> 6547 T341 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:56875
[junit4:junit4]   2> 6547 T341 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:56875
[junit4:junit4]   2> 6548 T343 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8f4bc5bb000a with negotiated timeout 20000 for client /127.0.0.1:56875
[junit4:junit4]   2> 6548 T422 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:38624, sessionid = 0x13b8f4bc5bb000a, negotiated timeout = 20000
[junit4:junit4]   2> 6548 T423 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c458e10 name:ZooKeeperConnection Watcher:127.0.0.1:38624 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6548 T339 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6549 T344 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8f4bc5bb000a
[junit4:junit4]   2> 6549 T423 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 6550 T341 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:56875 which had sessionid 0x13b8f4bc5bb000a
[junit4:junit4]   2> 6549 T339 oaz.ZooKeeper.close Session: 0x13b8f4bc5bb000a closed
[junit4:junit4]   2> 6550 T339 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:38624/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@1c343fb9
[junit4:junit4]   2> 6551 T424 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:38624. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 6551 T339 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6551 T341 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:56876
[junit4:junit4]   2> 6551 T424 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:38624, initiating session
[junit4:junit4]   2> 6552 T341 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:56876
[junit4:junit4]   2> 6553 T343 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8f4bc5bb000b with negotiated timeout 8000 for client /127.0.0.1:56876
[junit4:junit4]   2> 6553 T424 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:38624, sessionid = 0x13b8f4bc5bb000b, negotiated timeout = 8000
[junit4:junit4]   2> 6553 T425 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c343fb9 name:ZooKeeperConnection Watcher:127.0.0.1:38624/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6553 T339 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6554 T344 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f4bc5bb000b type:create cxid:0x1 zxid:0xa6 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6555 T344 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f4bc5bb000b type:create cxid:0x2 zxid:0xa7 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6555 T339 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50707_solr
[junit4:junit4]   2> 6556 T344 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f4bc5bb000b type:delete cxid:0x4 zxid:0xa8 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:50707_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:50707_solr
[junit4:junit4]   2> 6556 T339 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50707_solr
[junit4:junit4]   2> 6557 T361 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6557 T408 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6557 T393 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6558 T378 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 6558 T378 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6558 T339 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 6559 T339 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 6559 T408 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 6559 T361 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 6559 T393 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 6559 T339 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 6560 T339 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 6560 T339 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 6561 T339 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 6561 T339 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 6561 T339 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 6562 T339 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 6562 T339 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 6567 T339 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 6573 T426 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty4-1355318812360/collection1
[junit4:junit4]   2> 6573 T426 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 6573 T426 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 6574 T426 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 6574 T426 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty4-1355318812360/collection1/'
[junit4:junit4]   2> 6575 T426 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/solrtest-jetty4-1355318812360/collection1/lib/README' to classloader
[junit4:junit4]   2> 6575 T426 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/solrtest-jetty4-1355318812360/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 6647 T426 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 6705 T426 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 6706 T426 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 6712 T426 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 7219 T426 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 7226 T426 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 7230 T426 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 7238 T426 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 7241 T426 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 7244 T426 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 7245 T426 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 7246 T426 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty4-1355318812360/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1355318805943/jetty4/
[junit4:junit4]   2> 7246 T426 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1ad38771
[junit4:junit4]   2> 7247 T426 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1355318805943/jetty4/index/
[junit4:junit4]   2> 7247 T426 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1355318805943/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 7247 T426 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1355318805943/jetty4/index forceNew:false
[junit4:junit4]   2> 7250 T426 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1355318805943/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1b65e4f0; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 7251 T426 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 7251 T426 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 7252 T426 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 7252 T426 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 7253 T426 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 7253 T426 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 7253 T426 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 7253 T426 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 7254 T426 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 7254 T426 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 7255 T426 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 7256 T426 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 7257 T426 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 7257 T426 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 7258 T426 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 7258 T426 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 7258 T426 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 7259 T426 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 7260 T426 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7261 T426 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7262 T426 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7262 T426 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7263 T426 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7264 T426 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7265 T426 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7266 T426 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 7266 T426 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 7268 T426 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 7270 T426 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 7271 T426 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 7274 T426 oass.SolrIndexSearcher.<init> Opening Searcher@1b694e52 main
[junit4:junit4]   2> 7274 T426 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 7274 T426 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 7275 T426 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 7275 T426 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 7280 T426 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 7306 T427 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1b694e52 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 7313 T426 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 7314 T426 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 7517 T362 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7518 T362 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:50707_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:50707/solr"}
[junit4:junit4]   2> 7518 T362 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 7518 T362 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4]   2> 7521 T425 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7521 T361 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7521 T378 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7521 T393 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7521 T408 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7814 T426 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 7815 T426 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:50707/solr shardId:shard2
[junit4:junit4]   2> 7817 T426 oasc.ZkController.register We are http://127.0.0.1:50707/solr/collection1/ and leader is http://127.0.0.1:50246/solr/collection1/
[junit4:junit4]   2> 7817 T426 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:50707/solr
[junit4:junit4]   2> 7817 T426 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 7817 T426 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C16 name=collection1 org.apache.solr.core.SolrCore@1b65902f url=http://127.0.0.1:50707/solr/collection1 node=127.0.0.1:50707_solr
[junit4:junit4]   2> 7818 T428 C16 P50707 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 7818 T428 C16 P50707 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 7818 T426 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7818 T428 C16 P50707 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 7818 T428 C16 P50707 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 7819 T339 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   2> 7819 T428 C16 P50707 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:50246/solr/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 7819 T339 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 7819 T428 C16 P50707 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:50707/solr START replicas=[http://127.0.0.1:50246/solr/collection1/] nUpdates=100
[junit4:junit4]   2> 7820 T428 C16 P50707 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 7820 T339 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 7820 T428 C16 P50707 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 7820 T428 C16 P50707 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 7821 T428 C16 P50707 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 7824 T339 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:38624/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1b5a018e
[junit4:junit4]   2> ASYNC  NEW_CORE C17 name=collection1 org.apache.solr.core.SolrCore@1af7accc url=http://127.0.0.1:50246/solr/collection1 node=127.0.0.1:50246_solr
[junit4:junit4]   2> 7825 T386 C17 P50246 REQ /get {distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=0 
[junit4:junit4]   2> 7825 T430 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:38624. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 7825 T339 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 7826 T430 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:38624, initiating session
[junit4:junit4]   2> 7826 T341 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:56879
[junit4:junit4]   2> 7826 T341 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:56879
[junit4:junit4]   2> 7827 T343 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8f4bc5bb000c with negotiated timeout 10000 for client /127.0.0.1:56879
[junit4:junit4]   2> 7827 T430 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:38624, sessionid = 0x13b8f4bc5bb000c, negotiated timeout = 10000
[junit4:junit4]   2> 7827 T431 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b5a018e name:ZooKeeperConnection Watcher:127.0.0.1:38624/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 7827 T339 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 7828 T339 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 7829 T339 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 7830 T339 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 7834 T339 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> ASYNC  NEW_CORE C18 name=collection1 org.apache.solr.core.SolrCore@1af03818 url=http://127.0.0.1:35281/solr/collection1 node=127.0.0.1:35281_solr
[junit4:junit4]   2> 7849 T356 C18 P35281 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1355318805943/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1af08c29; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 7850 T356 C18 P35281 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 7853 T356 C18 P35281 /update {wt=javabin&version=2} {add=[1 (1421154780468740096)]} 0 7
[junit4:junit4]   2> 7854 T339 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:38624/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1b5bb4ef
[junit4:junit4]   2> 7855 T432 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:38624. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 7855 T339 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 7856 T341 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:56881
[junit4:junit4]   2> 7855 T432 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:38624, initiating session
[junit4:junit4]   2> 7856 T341 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:56881
[junit4:junit4]   2> 7857 T343 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8f4bc5bb000d with negotiated timeout 10000 for client /127.0.0.1:56881
[junit4:junit4]   2> 7857 T432 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:38624, sessionid = 0x13b8f4bc5bb000d, negotiated timeout = 10000
[junit4:junit4]   2> 7857 T433 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b5bb4ef name:ZooKeeperConnection Watcher:127.0.0.1:38624/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 7857 T339 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 7858 T339 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 7863 T374 C15 P43182 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1355318805943/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1b0867dc; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 7863 T374 C15 P43182 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2>  C14_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:38044_solr, base_url=http://127.0.0.1:38044/solr}
[junit4:junit4]   2> 7873 T403 C14 P38044 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1355318805943/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1c2be90f; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 7873 T403 C14 P38044 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 7875 T403 C14 P38044 REQ /update {distrib.from=http://127.0.0.1:43182/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=4 
[junit4:junit4]   2> 7876 T374 C15 P43182 REQ /update {distrib.from=http://127.0.0.1:50246/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=15 
[junit4:junit4]   2> 7877 T388 C17 P50246 /update {wt=javabin&version=2} {add=[1]} 0 17
[junit4:junit4]   2> 7878 T357 C18 P35281 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 7941 T357 C18 P35281 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1355318805943/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1af08c29; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1355318805943/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1af08c29; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[_0_Asserting_0.tim, _0_Asserting_0.tip, _0_TestBloomFilteredLucene41Postings_0.tim, _0_TestBloomFilteredLucene41Postings_0.tip, _0_MockFixedIntBlock_0.tib, _0_TestBloomFilteredLucene41Postings_0.pos, _0_MockFixedIntBlock_0.skp, _0_MockFixedIntBlock_0.pyl, _0_Pulsing41_0.tim, _0_MockFixedIntBlock_0.tii, _0_Pulsing41_0.tip, _0.si, _0_Asserting_0.doc, _0.fnm, _0_TestBloomFilteredLucene41Postings_0.blm, _0_MockFixedIntBlock_0.pos, _0_nrm.cfs, _0_MockFixedIntBlock_0.frq, _0_Pulsing41_0.pos, _0_Pulsing41_0.doc, _0_MockFixedIntBlock_0.doc, _0_nrm.cfe, segments_2, _0_TestBloomFilteredLucene41Postings_0.doc, _0.fdx, _0_Asserting_0.pos, _0.fdt]
[junit4:junit4]   2> 7945 T357 C18 P35281 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 7964 T357 C18 P35281 oass.SolrIndexSearcher.<init> Opening Searcher@1b97b31f main
[junit4:junit4]   2> 7964 T357 C18 P35281 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 7964 T357 C18 P35281 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 7966 T365 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1b97b31f main{StandardDirectoryReader(segments_2:3 _0(4.1):C1)}
[junit4:junit4]   2> 7967 T357 C18 P35281 /update {waitSearcher=true&wt=javabin&commit=true&softCommit=false&version=2} {commit=} 0 89
[junit4:junit4]   2> 7968 T389 C17 P50246 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 7970 T389 C17 P50246 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1355318805943/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1af80167; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 7971 T389 C17 P50246 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 7993 T389 C17 P50246 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1355318805943/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1af80167; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1355318805943/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1af80167; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 7993 T389 C17 P50246 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 7994 T389 C17 P50246 oass.SolrIndexSearcher.<init> Opening Searcher@1af2b2ef main
[junit4:junit4]   2> 7995 T389 C17 P50246 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 7995 T389 C17 P50246 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 7997 T395 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1af2b2ef main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 7997 T389 C17 P50246 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:43182/solr/collection1/, StdNode: http://127.0.0.1:38044/solr/collection1/, StdNode: http://127.0.0.1:50707/solr/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4]   2> 7999 T371 C15 P43182 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 7999 T401 C14 P38044 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 8008 T418 C16 P50707 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 8011 T418 C16 P50707 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1355318805943/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1b65e4f0; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 8011 T418 C16 P50707 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 8024 T362 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8025 T362 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:50707_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:50707/solr"}
[junit4:junit4]   2> 8033 T418 C16 P50707 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1355318805943/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1b65e4f0; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1355318805943/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1b65e4f0; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 8033 T418 C16 P50707 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 8034 T418 C16 P50707 oass.SolrIndexSearcher.<init> Opening Searcher@1b26663e main
[junit4:junit4]   2> 8035 T418 C16 P50707 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 8035 T418 C16 P50707 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 8037 T427 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1b26663e main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 8037 T418 C16 P50707 /update {waitSearcher=true&commit=true&commit_end_point=true&expungeDeletes=false&wt=javabin&softCommit=false&version=2} {commit=} 0 30
[junit4:junit4]   2> 8044 T425 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8044 T393 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8044 T433 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8044 T361 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8044 T408 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8044 T378 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8044 T431 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8075 T401 C14 P38044 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1355318805943/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1c2be90f; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1355318805943/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1c2be90f; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[_0_Asserting_0.tim, _0_Asserting_0.tip, _0_TestBloomFilteredLucene41Postings_0.tim, _0_TestBloomFilteredLucene41Postings_0.tip, _0_MockFixedIntBlock_0.tib, _0_TestBloomFilteredLucene41Postings_0.pos, _0_MockFixedIntBlock_0.skp, _0_MockFixedIntBlock_0.pyl, _0_Pulsing41_0.tim, _0_MockFixedIntBlock_0.tii, _0_Pulsing41_0.tip, _0.si, _0_Asserting_0.doc, _0.fnm, _0_TestBloomFilteredLucene41Postings_0.blm, _0_MockFixedIntBlock_0.pos, _0_nrm.cfs, _0_MockFixedIntBlock_0.frq, _0_Pulsing41_0.pos, _0_Pulsing41_0.doc, _0_MockFixedIntBlock_0.doc, _0_nrm.cfe, segments_2, _0_TestBloomFilteredLucene41Postings_0.doc, _0.fdx, _0_Asserting_0.pos, _0.fdt]
[junit4:junit4]   2> 8076 T401 C14 P38044 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 8076 T371 C15 P43182 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1355318805943/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1b0867dc; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1355318805943/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1b0867dc; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[_0_Asserting_0.tim, _0_Asserting_0.tip, _0_TestBloomFilteredLucene41Postings_0.tim, _0_TestBloomFilteredLucene41Postings_0.tip, _0_MockFixedIntBlock_0.tib, _0_TestBloomFilteredLucene41Postings_0.pos, _0_MockFixedIntBlock_0.skp, _0_MockFixedIntBlock_0.pyl, _0_Pulsing41_0.tim, _0_MockFixedIntBlock_0.tii, _0_Pulsing41_0.tip, _0.si, _0_Asserting_0.doc, _0.fnm, _0_TestBloomFilteredLucene41Postings_0.blm, _0_MockFixedIntBlock_0.pos, _0_nrm.cfs, _0_MockFixedIntBlock_0.frq, _0_Pulsing41_0.pos, _0_Pulsing41_0.doc, _0_MockFixedIntBlock_0.doc, _0_nrm.cfe, segments_2, _0_TestBloomFilteredLucene41Postings_0.doc, _0.fdx, _0_Asserting_0.pos, _0.fdt]
[junit4:junit4]   2> 8077 T371 C15 P43182 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 8085 T401 C14 P38044 oass.SolrIndexSearcher.<init> Opening Searcher@1b7eba71 main
[junit4:junit4]   2> 8085 T401 C14 P38044 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 8085 T401 C14 P38044 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 8086 T371 C15 P43182 oass.SolrIndexSearcher.<init> Opening Searcher@1b93de11 main
[junit4:junit4]   2> 8086 T371 C15 P43182 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 8086 T371 C15 P43182 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 8089 T380 oasc.JmxMonitoredMap.put WARNING Failed to register info bean: queryResultCache javax.management.InstanceAlreadyExistsException: solr/collection1:type=queryResultCache,id=org.apache.solr.search.LRUCache
[junit4:junit4]   2> 	at com.sun.jmx.mbeanserver.Repository.addMBean(Repository.java:453)
[junit4:junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.internal_addObject(DefaultMBeanServerInterceptor.java:1484)
[junit4:junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:963)
[junit4:junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:917)
[junit4:junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:312)
[junit4:junit4]   2> 	at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:482)
[junit4:junit4]   2> 	at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:140)
[junit4:junit4]   2> 	at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:51)
[junit4:junit4]   2> 	at org.apache.solr.search.SolrIndexSearcher.register(SolrIndexSearcher.java:246)
[junit4:junit4]   2> 	at org.apache.solr.core.SolrCore.registerSearcher(SolrCore.java:1701)
[junit4:junit4]   2> 	at org.apache.solr.core.SolrCore.access$000(SolrCore.java:124)
[junit4:junit4]   2> 	at org.apache.solr.core.SolrCore$7.call(SolrCore.java:1577)
[junit4:junit4]   2> 	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[junit4:junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:139)
[junit4:junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
[junit4:junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:909)
[junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:662)
[junit4:junit4]   2> 
[junit4:junit4]   2> 8089 T410 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1b7eba71 main{StandardDirectoryReader(segments_2:3 _0(4.1):C1)}
[junit4:junit4]   2> 8089 T380 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1b93de11 main{StandardDirectoryReader(segments_2:3 _0(4.1):C1)}
[junit4:junit4]   2> 8090 T401 C14 P38044 /update {waitSearcher=true&commit=true&commit_end_point=true&expungeDeletes=false&wt=javabin&softCommit=false&version=2} {commit=} 0 91
[junit4:junit4]   2> 8090 T371 C15 P43182 /update {waitSearcher=true&commit=true&commit_end_point=true&expungeDeletes=false&wt=javabin&softCommit=false&version=2} {commit=} 0 91
[junit4:junit4]   2> 8091 T389 C17 P50246 /update {waitSearcher=true&wt=javabin&commit=true&softCommit=false&version=2} {commit=} 0 123
[junit4:junit4]   2> 8091 T339 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):540
[junit4:junit4]   2> 8092 T339 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9093 T339 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9436 T411 C14 P38044 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 9437 T411 C14 P38044 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 9437 T411 C14 P38044 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:43182/solr/collection1/. core=collection1
[junit4:junit4]   2> 9437 T411 C14 P38044 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 9442 T372 C15 P43182 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 9475 T372 C15 P43182 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1355318805943/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1b0867dc; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[_0_Asserting_0.tim, _0_Asserting_0.tip, _0_TestBloomFilteredLucene41Postings_0.tim, _0_TestBloomFilteredLucene41Postings_0.tip, _0_MockFixedIntBlock_0.tib, _0_TestBloomFilteredLucene41Postings_0.pos, _0_MockFixedIntBlock_0.skp, _0_MockFixedIntBlock_0.pyl, _0_Pulsing41_0.tim, _0_MockFixedIntBlock_0.tii, _0_Pulsing41_0.tip, _0.si, _0_Asserting_0.doc, _0.fnm, _0_TestBloomFilteredLucene41Postings_0.blm, _0_MockFixedIntBlock_0.pos, _0_nrm.cfs, _0_MockFixedIntBlock_0.frq, _0_Pulsing41_0.pos, _0_Pulsing41_0.doc, _0_MockFixedIntBlock_0.doc, _0_nrm.cfe, segments_2, _0_TestBloomFilteredLucene41Postings_0.doc, _0.fdx, _0_Asserting_0.pos, _0.fdt]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1355318805943/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1b0867dc; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[_0_Asserting_0.tim, _0_Asserting_0.tip, _0_TestBloomFilteredLucene41Postings_0.tim, _0_TestBloomFilteredLucene41Postings_0.tip, _0_MockFixedIntBlock_0.tib, _0_TestBloomFilteredLucene41Postings_0.pos, _0_MockFixedIntBlock_0.skp, _0_MockFixedIntBlock_0.pyl, _0_Pulsing41_0.tim, _0_MockFixedIntBlock_0.tii, _0_Pulsing41_0.tip, _0.si, _0_Asserting_0.doc, _0.fnm, _0_TestBloomFilteredLucene41Postings_0.blm, _0_MockFixedIntBlock_0.pos, _0_nrm.cfs, _0_MockFixedIntBlock_0.frq, _0_Pulsing41_0.pos, _0_Pulsing41_0.doc, _0_MockFixedIntBlock_0.doc, _0_nrm.cfe, _0_TestBloomFilteredLucene41Postings_0.doc, _0.fdx, _0_Asserting_0.pos, _0.fdt, segments_3]
[junit4:junit4]   2> 9475 T372 C15 P43182 oasc.SolrDeletionPolicy.updateCommits newest commit = 3
[junit4:junit4]   2> 9484 T372 C15 P43182 oass.SolrIndexSearcher.<init> Opening Searcher@1b59e4c7 realtime
[junit4:junit4]   2> 9485 T372 C15 P43182 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 9485 T372 C15 P43182 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 9485 T372 C15 P43182 /update {waitSearcher=true&openSearcher=false&commit=true&commit_end_point=true&wt=javabin&softCommit=false&version=2} {commit=} 0 43
[junit4:junit4]   2> 9486 T411 C14 P38044 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 9486 T411 C14 P38044 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 9488 T371 C15 P43182 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 9488 T371 C15 P43182 REQ /replication {command=indexversion&wt=javabin&qt=/replication&version=2} status=0 QTime=1 
[junit4:junit4]   2> 9488 T411 C14 P38044 oash.SnapPuller.fetchLatestIndex Master's generation: 3
[junit4:junit4]   2> 9488 T411 C14 P38044 oash.SnapPuller.fetchLatestIndex Slave's generation: 2
[junit4:junit4]   2> 9489 T411 C14 P38044 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 9494 T372 C15 P43182 REQ /replication {command=filelist&generation=3&wt=javabin&qt=/replication&version=2} status=0 QTime=4 
[junit4:junit4]   2> 9494 T411 C14 P38044 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 27
[junit4:junit4]   2> 9497 T411 C14 P38044 oash.SnapPuller.fetchLatestIndex Starting download to ./org.apache.solr.cloud.BasicDistributedZk2Test-1355318805943/jetty3/index.20121212142655419 fullCopy=true
[junit4:junit4]   2> 9499 T373 C15 P43182 REQ /replication {file=_0_Asserting_0.tim&command=filecontent&checksum=true&generation=3&qt=/replication&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 9502 T374 C15 P43182 REQ /replication {file=_0_Asserting_0.tip&command=filecontent&checksum=true&generation=3&qt=/replication&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 9504 T371 C15 P43182 REQ /replication {file=_0_TestBloomFilteredLucene41Postings_0.tim&command=filecontent&checksum=true&generation=3&qt=/replication&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 9507 T372 C15 P43182 REQ /replication {file=_0_TestBloomFilteredLucene41Postings_0.tip&command=filecontent&checksum=true&generation=3&qt=/replication&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 9509 T373 C15 P43182 REQ /replication {file=_0_MockFixedIntBlock_0.tib&command=filecontent&checksum=true&generation=3&qt=/replication&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 9512 T374 C15 P43182 REQ /replication {file=_0_TestBloomFilteredLucene41Postings_0.pos&command=filecontent&checksum=true&generation=3&qt=/replication&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 9514 T371 C15 P43182 REQ /replication {file=_0_MockFixedIntBlock_0.pyl&command=filecontent&checksum=true&generation=3&qt=/replication&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 9515 T411 C14 P38044 oash.SnapPuller$FileFetcher.fetchPackets WARNING No content recieved for file: {name=_0_MockFixedIntBlock_0.pyl, lastmodified=1355318813000, size=0}
[junit4:junit4]   2> 9517 T372 C15 P43182 REQ /replication {file=_0_MockFixedIntBlock_0.skp&command=filecontent&checksum=true&generation=3&qt=/replication&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 9518 T411 C14 P38044 oash.SnapPuller$FileFetcher.fetchPackets WARNING No content recieved for file: {name=_0_MockFixedIntBlock_0.skp, lastmodified=1355318813000, size=0}
[junit4:junit4]   2> 9520 T373 C15 P43182 REQ /replication {file=_0_Pulsing41_0.tim&command=filecontent&checksum=true&generation=3&qt=/replication&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 9522 T374 C15 P43182 REQ /replication {file=_0_Pulsing41_0.tip&command=filecontent&checksum=true&generation=3&qt=/replication&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 9526 T371 C15 P43182 REQ /replication {file=_0_MockFixedIntBlock_0.tii&command=filecontent&checksum=true&generation=3&qt=/replication&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 9528 T372 C15 P43182 REQ /replication {file=_0.si&command=filecontent&checksum=true&generation=3&qt=/replication&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 9531 T373 C15 P43182 REQ /replication {file=_0_Asserting_0.doc&command=filecontent&checksum=true&generation=3&qt=/replication&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 9534 T374 C15 P43182 REQ /replication {file=_0.fnm&command=filecontent&checksum=true&generation=3&qt=/replication&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 9537 T371 C15 P43182 REQ /replication {file=_0_TestBloomFilteredLucene41Postings_0.blm&command=filecontent&checksum=true&generation=3&qt=/replication&wt=filestream} status=0 QTime=1 
[junit4:junit4]   2> 9539 T372 C15 P43182 REQ /replication {file=_0_MockFixedIntBlock_0.pos&command=filecontent&checksum=true&generation=3&qt=/replication&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 9542 T373 C15 P43182 REQ /replication {file=_0_nrm.cfs&command=filecontent&checksum=true&generation=3&qt=/replication&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 9544 T374 C15 P43182 REQ /replication {file=_0_MockFixedIntBlock_0.frq&command=filecontent&checksum=true&generation=3&qt=/replication&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 9547 T371 C15 P43182 REQ /replication {file=_0_Pulsing41_0.doc&command=filecontent&checksum=true&generation=3&qt=/replication&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 9549 T372 C15 P43182 REQ /replication {file=_0_Pulsing41_0.pos&command=filecontent&checksum=true&generation=3&qt=/replication&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 9552 T373 C15 P43182 REQ /replication {file=_0_MockFixedIntBlock_0.doc&command=filecontent&checksum=true&generation=3&qt=/replication&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 9555 T374 C15 P43182 REQ /replication {file=_0_nrm.cfe&command=filecontent&checksum=true&generation=3&qt=/replication&wt=filestream} status=0 QTime=1 
[junit4:junit4]   2> 9557 T371 C15 P43182 REQ /replication {file=_0_TestBloomFilteredLucene41Postings_0.doc&command=filecontent&checksum=true&generation=3&qt=/replication&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 9560 T372 C15 P43182 REQ /replication {file=_0.fdx&command=filecontent&checksum=true&generation=3&qt=/replication&wt=filestream} status=0 QTime=1 
[junit4:junit4]   2> 9562 T373 C15 P43182 REQ /replication {file=_0_Asserting_0.pos&command=filecontent&checksum=true&generation=3&qt=/replication&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 9614 T374 C15 P43182 REQ /replication {file=segments_3&command=filecontent&checksum=true&generation=3&qt=/replication&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 9616 T371 C15 P43182 REQ /replication {file=_0.fdt&command=filecontent&checksum=true&generation=3&qt=/replication&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 9617 T411 C14 P38044 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 9618 T411 C14 P38044 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20121212142655419
[junit4:junit4]   2> 9619 T411 C14 P38044 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 9619 T411 C14 P38044 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 9619 T411 C14 P38044 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4]   2> 9624 T411 C14 P38044 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.BasicDistributedZk2Test-1355318805943/jetty3/index/ new=./org.apache.solr.cloud.BasicDistributedZk2Test-1355318805943/jetty3/index.20121212142655419
[junit4:junit4]   2> 9625 T411 C14 P38044 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1355318805943/jetty3/index.20121212142655419 forceNew:true
[junit4:junit4]   2> 9630 T411 C14 P38044 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1355318805943/jetty3/index.20121212142655419 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1af45f31; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[_0_Asserting_0.tim, _0_Asserting_0.tip, _0_TestBloomFilteredLucene41Postings_0.tim, _0_TestBloomFilteredLucene41Postings_0.tip, _0_MockFixedIntBlock_0.tib, _0_TestBloomFilteredLucene41Postings_0.pos, _0_MockFixedIntBlock_0.pyl, _0_MockFixedIntBlock_0.skp, _0_Pulsing41_0.tim, _0_Pulsing41_0.tip, _0_MockFixedIntBlock_0.tii, _0.si, _0_Asserting_0.doc, _0.fnm, _0_TestBloomFilteredLucene41Postings_0.blm, _0_MockFixedIntBlock_0.pos, _0_nrm.cfs, _0_MockFixedIntBlock_0.frq, _0_Pulsing41_0.pos, _0_Pulsing41_0.doc, _0_MockFixedIntBlock_0.doc, _0_nrm.cfe, _0_TestBloomFilteredLucene41Postings_0.doc, _0.fdx, _0_Asserting_0.pos, _0.fdt, segments_3]
[junit4:junit4]   2> 9631 T411 C14 P38044 oasc.SolrDeletionPolicy.updateCommits newest commit = 3
[junit4:junit4]   2> 9632 T411 C14 P38044 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 9634 T411 C14 P38044 oass.SolrIndexSearcher.<init> Opening Searcher@1af41f55 main
[junit4:junit4]   2> 9634 T411 C14 P38044 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 9636 T410 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1af41f55 main{StandardDirectoryReader(segments_3:3:nrt _0(4.1):C1)}
[junit4:junit4]   2> 9637 T410 oasc.CachingDirectoryFactory.close Closing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1355318805943/jetty3/index
[junit4:junit4]   2> 9637 T410 oash.SnapPuller$2.onClose removing old index directory ./org.apache.solr.cloud.BasicDistributedZk2Test-1355318805943/jetty3/index
[junit4:junit4]   2> 9640 T411 C14 P38044 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 9825 T411 C14 P38044 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1355318805943/jetty3/index.20121212142655419 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1af45f31; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[_0_Asserting_0.tim, _0_Asserting_0.tip, _0_TestBloomFilteredLucene41Postings_0.tim, _0_TestBloomFilteredLucene41Postings_0.tip, _0_MockFixedIntBlock_0.tib, _0_TestBloomFilteredLucene41Postings_0.pos, _0_MockFixedIntBlock_0.pyl, _0_MockFixedIntBlock_0.skp, _0_Pulsing41_0.tim, _0_Pulsing41_0.tip, _0_MockFixedIntBlock_0.tii, _0.si, _0_Asserting_0.doc, _0.fnm, _0_TestBloomFilteredLucene41Postings_0.blm, _0_MockFixedIntBlock_0.pos, _0_nrm.cfs, _0_MockFixedIntBlock_0.frq, _0_Pulsing41_0.pos, _0_Pulsing41_0.doc, _0_MockFixedIntBlock_0.doc, _0_nrm.cfe, _0_TestBloomFilteredLucene41Postings_0.doc, _0.fdx, _0_Asserting_0.pos, _0.fdt, segments_3]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1355318805943/jetty3/index.20121212142655419 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1af45f31; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_4,generation=4,filenames=[_0_Asserting_0.tim, _0_Asserting_0.tip, _0_TestBloomFilteredLucene41Postings_0.tim, _0_TestBloomFilteredLucene41Postings_0.tip, _0_MockFixedIntBlock_0.tib, _0_TestBloomFilteredLucene41Postings_0.pos, _0_MockFixedIntBlock_0.pyl, _0_MockFixedIntBlock_0.skp, _0_Pulsing41_0.tim, _0_Pulsing41_0.tip, _0_MockFixedIntBlock_0.tii, _0.si, _0_Asserting_0.doc, _0.fnm, _0_TestBloomFilteredLucene41Postings_0.blm, _0_MockFixedIntBlock_0.pos, _0_nrm.cfs, _0_MockFixedIntBlock_0.frq, _0_Pulsing41_0.pos, _0_Pulsing41_0.doc, _0_MockFixedIntBlock_0.doc, _0_nrm.cfe, _0_TestBloomFilteredLucene41Postings_0.doc, _0.fdx, _0_Asserting_0.pos, _0.fdt, segments_4]
[junit4:junit4]   2> 9826 T411 C14 P38044 oasc.SolrDeletionPolicy.updateCommits newest commit = 4
[junit4:junit4]   2> 9828 T411 C14 P38044 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 9828 T411 C14 P38044 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 9828 T411 C14 P38044 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 9828 T411 C14 P38044 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 9828 T411 C14 P38044 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 9829 T411 C14 P38044 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 10051 T362 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10051 T362 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:38044_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:38044/solr"}
[junit4:junit4]   2> 10063 T361 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10063 T425 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10063 T431 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10063 T378 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10063 T433 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10063 T408 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10063 T393 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10094 T339 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2>  C16_STATE=coll:collection1 core:collection1 props:{shard=shard2, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:50707_solr, base_url=http://127.0.0.1:50707/solr}
[junit4:junit4]   2> 10825 T428 C16 P50707 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 10826 T428 C16 P50707 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 10826 T428 C16 P50707 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:50246/solr/collection1/. core=collection1
[junit4:junit4]   2> 10826 T428 C16 P50707 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 10832 T389 C17 P50246 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 10843 T389 C17 P50246 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1355318805943/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1af80167; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1355318805943/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1af80167; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 10843 T389 C17 P50246 oasc.SolrDeletionPolicy.updateCommits newest commit = 3
[junit4:junit4]   2> 10844 T389 C17 P50246 oass.SolrIndexSearcher.<init> Opening Searcher@1aec1ead realtime
[junit4:junit4]   2> 10844 T389 C17 P50246 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 10845 T389 C17 P50246 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 10845 T389 C17 P50246 /update {waitSearcher=true&openSearcher=false&commit=true&commit_end_point=true&wt=javabin&softCommit=false&version=2} {commit=} 0 13
[junit4:junit4]   2> 10846 T428 C16 P50707 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 10846 T428 C16 P50707 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 10848 T388 C17 P50246 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 10848 T388 C17 P50246 REQ /replication {command=indexversion&wt=javabin&qt=/replication&version=2} status=0 QTime=1 
[junit4:junit4]   2> 10848 T428 C16 P50707 oash.SnapPuller.fetchLatestIndex Master's generation: 3
[junit4:junit4]   2> 10849 T428 C16 P50707 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 10849 T428 C16 P50707 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 10851 T387 C17 P50246 REQ /replication {command=filelist&generation=3&wt=javabin&qt=/replication&version=2} status=0 QTime=1 
[junit4:junit4]   2> 10851 T428 C16 P50707 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 10852 T428 C16 P50707 oash.SnapPuller.fetchLatestIndex Starting download to ./org.apache.solr.cloud.BasicDistributedZk2Test-1355318805943/jetty4/index.20121212142656776 fullCopy=true
[junit4:junit4]   2> 10854 T389 C17 P50246 REQ /replication {file=segments_3&command=filecontent&checksum=true&generation=3&qt=/replication&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 10855 T428 C16 P50707 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 10862 T428 C16 P50707 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20121212142656776
[junit4:junit4]   2> 10863 T428 C16 P50707 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 10863 T428 C16 P50707 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 10864 T428 C16 P50707 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4]   2> 10865 T428 C16 P50707 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.BasicDistributedZk2Test-1355318805943/jetty4/index/ new=./org.apache.solr.cloud.BasicDistributedZk2Test-1355318805943/jetty4/index.20121212142656776
[junit4:junit4]   2> 10866 T428 C16 P50707 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1355318805943/jetty4/index.20121212142656776 forceNew:true
[junit4:junit4]   2> 10868 T428 C16 P50707 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1355318805943/jetty4/index.20121212142656776 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1b15a84c; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 10868 T428 C16 P50707 oasc.SolrDeletionPolicy.updateCommits newest commit = 3
[junit4:junit4]   2> 10869 T428 C16 P50707 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 10869 T428 C16 P50707 oass.SolrIndexSearcher.<init> Opening Searcher@1b167d55 main
[junit4:junit4]   2> 10870 T428 C16 P50707 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 10872 T427 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1b167d55 main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4

[...truncated too long message...]

Test.java:795)
[junit4:junit4]    > 	at org.apache.solr.cloud.BasicDistributedZkTest.doTest(BasicDistributedZkTest.java:344)
[junit4:junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
[junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:597)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:738)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:774)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:683)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:44)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:56)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:662)
[junit4:junit4]   2> 378220 T1131 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> NOTE: test params are: codec=Lucene41: {n_f1=PostingsFormat(name=TestBloomFilteredLucene41Postings), foo_b=PostingsFormat(name=SimpleText), cat=MockFixedIntBlock(blockSize=490), foo_d=Pulsing41(freqCutoff=8 minBlockSize=21 maxBlockSize=86), foo_f=PostingsFormat(name=SimpleText), n_tl1=PostingsFormat(name=TestBloomFilteredLucene41Postings), n_d1=MockFixedIntBlock(blockSize=490), rnd_b=Pulsing41(freqCutoff=8 minBlockSize=21 maxBlockSize=86), intDefault=MockFixedIntBlock(blockSize=490), n_td1=PostingsFormat(name=TestBloomFilteredLucene41Postings), id=Pulsing41(freqCutoff=8 minBlockSize=21 maxBlockSize=86), timestamp=MockFixedIntBlock(blockSize=490), range_facet_sl=PostingsFormat(name=SimpleText), range_facet_si=PostingsFormat(name=TestBloomFilteredLucene41Postings), oddField_s=Pulsing41(freqCutoff=8 minBlockSize=21 maxBlockSize=86), sequence_i=Pulsing41(freqCutoff=8 minBlockSize=21 maxBlockSize=86), name=Pulsing41(freqCutoff=8 minBlockSize=21 maxBlockSize=86), foo_i=PostingsFormat(name=TestBloomFilteredLucene41Postings), regex_dup_B_s=MockFixedIntBlock(blockSize=490), multiDefault=PostingsFormat(name=TestBloomFilteredLucene41Postings), n_tf1=MockFixedIntBlock(blockSize=490), n_dt1=PostingsFormat(name=TestBloomFilteredLucene41Postings), genre_s=Pulsing41(freqCutoff=8 minBlockSize=21 maxBlockSize=86), author_t=PostingsFormat(name=TestBloomFilteredLucene41Postings), n_ti1=Pulsing41(freqCutoff=8 minBlockSize=21 maxBlockSize=86), range_facet_l=MockFixedIntBlock(blockSize=490), text=PostingsFormat(name=SimpleText), _version_=MockFixedIntBlock(blockSize=490), val_i=Pulsing41(freqCutoff=8 minBlockSize=21 maxBlockSize=86), SubjectTerms_mfacet=MockFixedIntBlock(blockSize=490), series_t=PostingsFormat(name=TestBloomFilteredLucene41Postings), a_t=MockFixedIntBlock(blockSize=490), n_tdt1=MockFixedIntBlock(blockSize=490), regex_dup_A_s=Pulsing41(freqCutoff=8 minBlockSize=21 maxBlockSize=86), price=PostingsFormat(name=SimpleText), other_tl1=MockFixedIntBlock(blockSize=490), n_l1=MockFixedIntBlock(blockSize=490), a_si=PostingsFormat(name=TestBloomFilteredLucene41Postings), inStock=Pulsing41(freqCutoff=8 minBlockSize=21 maxBlockSize=86)}, sim=DefaultSimilarity, locale=ca, timezone=Europe/Copenhagen
[junit4:junit4]   2> NOTE: Linux 3.2.0-34-generic i386/Oracle Corporation 1.6.0_33 (32-bit)/cpus=8,threads=1,free=140664776,total=536870912
[junit4:junit4]   2> NOTE: All tests run in this JVM: [TestRandomFaceting, SimplePostToolTest, ScriptEngineTest, SuggesterWFSTTest, TestSuggestSpellingConverter, SpellCheckCollatorTest, StatelessScriptUpdateProcessorFactoryTest, TestBadConfig, LeaderElectionIntegrationTest, TestAtomicUpdateErrorCases, NotRequiredUniqueKeyTest, DirectUpdateHandlerOptimizeTest, TestGroupingSearch, SolrPluginUtilsTest, CopyFieldTest, AlternateDirectoryTest, SampleTest, TestQuerySenderNoQuery, CurrencyFieldTest, CoreAdminHandlerTest, TestJoin, TestNumberUtils, AnalysisAfterCoreReloadTest, SortByFunctionTest, BinaryUpdateRequestHandlerTest, DistanceFunctionTest, TestBinaryResponseWriter, FieldAnalysisRequestHandlerTest, NumericFieldsTest, TestLFUCache, TermsComponentTest, SolrRequestParserTest, SimpleFacetsTest, TestRangeQuery, TestAnalyzedSuggestions, DistributedTermsComponentTest, SuggesterFSTTest, DirectSolrConnectionTest, CircularListTest, TestFastLRUCache, TestConfig, UniqFieldsUpdateProcessorFactoryTest, TestJmxMonitoredMap, SpatialFilterTest, SpellPossibilityIteratorTest, TestIndexingPerformance, TestPerFieldSimilarity, DistributedSpellCheckComponentTest, RequestHandlersTest, SolrCmdDistributorTest, TestSolrQueryParser, DateFieldTest, TestElisionMultitermQuery, TestExtendedDismaxParser, SolrCoreCheckLockOnStartupTest, BasicDistributedZkTest]
[junit4:junit4] Completed on J0 in 378.38s, 1 test, 1 error <<< FAILURES!

[...truncated 442 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:352: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:178: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:438: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1171: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:835: There were test failures: 239 suites, 994 tests, 1 error, 1 failure, 7 ignored (2 assumptions)

Total time: 45 minutes 58 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 32bit/jrockit-jdk1.6.0_33-R28.2.4-4.1.0 -XnoOpt
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-4.x-Linux (32bit/jdk1.8.0-ea-b65) - Build # 3182 - Still Failing!

Posted by Policeman Jenkins Server <je...@sd-datasolutions.de>.
Build: http://jenkins.sd-datasolutions.de/job/Lucene-Solr-4.x-Linux/3182/
Java: 32bit/jdk1.8.0-ea-b65 -client -XX:+UseParallelGC

2 tests failed.
FAILED:  org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch

Error Message:
There are still nodes recoverying - waited for 540 seconds

Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 540 seconds
	at __randomizedtesting.SeedInfo.seed([FC22DC14340EDE3F:7DC4520C4351BE03]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:165)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:115)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:110)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:563)
	at org.apache.solr.cloud.BasicDistributedZk2Test.brindDownShardIndexSomeDocsAndRecover(BasicDistributedZk2Test.java:321)
	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:83)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:474)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)


FAILED:  org.apache.solr.cloud.BasicDistributedZkTest.testDistribSearch

Error Message:
Server at http://127.0.0.1:60354/solr returned non ok status:500, message:Server Error

Stack Trace:
org.apache.solr.common.SolrException: Server at http://127.0.0.1:60354/solr returned non ok status:500, message:Server Error
	at __randomizedtesting.SeedInfo.seed([FC22DC14340EDE3F:7DC4520C4351BE03]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:374)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
	at org.apache.solr.client.solrj.request.CoreAdminRequest.process(CoreAdminRequest.java:429)
	at org.apache.solr.client.solrj.request.CoreAdminRequest.getStatus(CoreAdminRequest.java:472)
	at org.apache.solr.cloud.BasicDistributedZkTest.collectStartTimes(BasicDistributedZkTest.java:959)
	at org.apache.solr.cloud.BasicDistributedZkTest.testCollectionsAPI(BasicDistributedZkTest.java:795)
	at org.apache.solr.cloud.BasicDistributedZkTest.doTest(BasicDistributedZkTest.java:343)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:474)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)




Build Log:
[...truncated 8743 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZkTest
[junit4:junit4]   2> 3 T983 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZkTest-1355314081515
[junit4:junit4]   2> 4 T983 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 4 T984 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 5 T984 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 5 T984 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4]   2> 5 T984 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4]   2> 6 T984 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 6 T984 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355314081515/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4]   2> 105 T983 oasc.ZkTestServer.run start zk server on port:60056
[junit4:junit4]   2> 105 T983 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60056 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@179f255
[junit4:junit4]   2> 106 T983 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 106 T989 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:60056. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 107 T989 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:60056, initiating session
[junit4:junit4]   2> 107 T985 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:40945
[junit4:junit4]   2> 107 T985 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:40945
[junit4:junit4]   2> 108 T987 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 109 T987 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8f03aeee0000 with negotiated timeout 10000 for client /127.0.0.1:40945
[junit4:junit4]   2> 109 T989 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:60056, sessionid = 0x13b8f03aeee0000, negotiated timeout = 10000
[junit4:junit4]   2> 110 T990 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@179f255 name:ZooKeeperConnection Watcher:127.0.0.1:60056 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 110 T983 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 110 T983 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 112 T988 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8f03aeee0000
[junit4:junit4]   2> 113 T985 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:40945 which had sessionid 0x13b8f03aeee0000
[junit4:junit4]   2> 113 T990 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 113 T983 oaz.ZooKeeper.close Session: 0x13b8f03aeee0000 closed
[junit4:junit4]   2> 114 T983 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60056/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@16a691f
[junit4:junit4]   2> 115 T991 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:60056. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 114 T983 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 115 T991 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:60056, initiating session
[junit4:junit4]   2> 115 T985 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:40946
[junit4:junit4]   2> 115 T985 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:40946
[junit4:junit4]   2> 116 T987 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8f03aeee0001 with negotiated timeout 10000 for client /127.0.0.1:40946
[junit4:junit4]   2> 116 T991 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:60056, sessionid = 0x13b8f03aeee0001, negotiated timeout = 10000
[junit4:junit4]   2> 116 T992 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@16a691f name:ZooKeeperConnection Watcher:127.0.0.1:60056/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 116 T983 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 117 T983 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 118 T983 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 120 T983 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 121 T983 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 123 T983 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 123 T983 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 126 T983 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 127 T983 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 129 T983 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 130 T983 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 132 T983 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 132 T983 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 134 T983 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 135 T983 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 136 T983 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 137 T983 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 138 T983 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 139 T983 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 141 T983 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 141 T983 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 143 T983 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 143 T983 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 145 T983 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 146 T983 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 147 T988 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8f03aeee0001
[junit4:junit4]   2> 148 T992 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 148 T985 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:40946 which had sessionid 0x13b8f03aeee0001
[junit4:junit4]   2> 148 T983 oaz.ZooKeeper.close Session: 0x13b8f03aeee0001 closed
[junit4:junit4]   2> 199 T983 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 207 T983 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:41009
[junit4:junit4]   2> 207 T983 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 208 T983 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355314081659
[junit4:junit4]   2> 209 T983 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355314081659/'
[junit4:junit4]   2> 224 T983 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 225 T983 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 225 T983 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355314081659
[junit4:junit4]   2> 225 T983 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355314081659/solr.xml
[junit4:junit4]   2> 226 T983 oasc.CoreContainer.<init> New CoreContainer 24999836
[junit4:junit4]   2> 226 T983 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355314081659/'
[junit4:junit4]   2> 226 T983 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355314081659/'
[junit4:junit4]   2> 241 T983 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 251 T983 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:60056/solr
[junit4:junit4]   2> 251 T983 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 252 T983 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60056 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1f2c2e0
[junit4:junit4]   2> 252 T1002 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:60056. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 252 T983 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 253 T1002 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:60056, initiating session
[junit4:junit4]   2> 253 T985 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:40947
[junit4:junit4]   2> 253 T985 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:40947
[junit4:junit4]   2> 254 T987 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8f03aeee0002 with negotiated timeout 20000 for client /127.0.0.1:40947
[junit4:junit4]   2> 254 T1002 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:60056, sessionid = 0x13b8f03aeee0002, negotiated timeout = 20000
[junit4:junit4]   2> 254 T1003 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f2c2e0 name:ZooKeeperConnection Watcher:127.0.0.1:60056 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 254 T983 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 255 T988 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8f03aeee0002
[junit4:junit4]   2> 256 T1003 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 256 T985 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:40947 which had sessionid 0x13b8f03aeee0002
[junit4:junit4]   2> 256 T983 oaz.ZooKeeper.close Session: 0x13b8f03aeee0002 closed
[junit4:junit4]   2> 256 T983 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60056/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@1825420
[junit4:junit4]   2> 257 T1004 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:60056. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 257 T983 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 258 T1004 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:60056, initiating session
[junit4:junit4]   2> 258 T985 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:40948
[junit4:junit4]   2> 258 T985 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:40948
[junit4:junit4]   2> 259 T987 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8f03aeee0003 with negotiated timeout 8000 for client /127.0.0.1:40948
[junit4:junit4]   2> 259 T1004 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:60056, sessionid = 0x13b8f03aeee0003, negotiated timeout = 8000
[junit4:junit4]   2> 259 T1005 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1825420 name:ZooKeeperConnection Watcher:127.0.0.1:60056/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 259 T983 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 260 T988 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f03aeee0003 type:create cxid:0x2 zxid:0x1b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 262 T983 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 263 T983 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41009_solr
[junit4:junit4]   2> 264 T988 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f03aeee0003 type:delete cxid:0x7 zxid:0x1d txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:41009_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:41009_solr
[junit4:junit4]   2> 265 T983 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:41009_solr
[junit4:junit4]   2> 266 T983 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 267 T983 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 267 T983 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 267 T983 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 268 T983 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 268 T983 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 269 T983 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 269 T983 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 269 T983 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 270 T983 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 273 T983 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 276 T988 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f03aeee0003 type:delete cxid:0x15 zxid:0x22 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 277 T983 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 278 T983 oasc.Overseer.start Overseer (id=88821863646363651-127.0.0.1:41009_solr-n_0000000000) starting
[junit4:junit4]   2> 279 T988 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f03aeee0003 type:create cxid:0x1a zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 280 T988 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f03aeee0003 type:create cxid:0x1b zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 280 T988 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f03aeee0003 type:create cxid:0x1c zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 281 T988 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f03aeee0003 type:create cxid:0x1d zxid:0x27 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 282 T1007 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
[junit4:junit4]   2> 282 T983 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 283 T983 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 285 T1006 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 289 T1008 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355314081659/collection1
[junit4:junit4]   2> 289 T1008 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4]   2> 289 T1008 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 289 T1008 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4]   2> 290 T1008 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355314081659/collection1/'
[junit4:junit4]   2> 291 T1008 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355314081659/collection1/lib/README' to classloader
[junit4:junit4]   2> 291 T1008 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355314081659/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 322 T1008 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 369 T1008 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 369 T1008 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 374 T1008 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 767 T1008 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 773 T1008 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 776 T1008 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 785 T1008 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 788 T1008 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 791 T1008 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 792 T1008 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 793 T1008 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355314081659/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355314081515/control/data/
[junit4:junit4]   2> 794 T1008 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@78f54
[junit4:junit4]   2> 801 T1008 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355314081515/control/data/index/
[junit4:junit4]   2> 801 T1008 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355314081515/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 802 T1008 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355314081515/control/data/index forceNew:false
[junit4:junit4]   2> 805 T1008 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355314081515/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@fab11b; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 806 T1008 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 806 T1008 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 807 T1008 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 807 T1008 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 808 T1008 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 808 T1008 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 808 T1008 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 809 T1008 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 809 T1008 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 810 T1008 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 810 T1008 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 811 T1008 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 811 T1008 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 812 T1008 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 812 T1008 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 812 T1008 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 813 T1008 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 813 T1008 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 814 T1008 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 814 T1008 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 815 T1008 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 816 T1008 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 816 T1008 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 817 T1008 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 817 T1008 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 818 T1008 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 818 T1008 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 821 T1008 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 823 T1008 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 824 T1008 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, STOPWORDS.TXT, MAPPING-ISOLATIN1ACCENT.TXT, SYNONYMS.TXT, OLD_SYNONYMS.TXT, CURRENCY.XML, OPEN-EXCHANGE-RATES.JSON, PROTWORDS.TXT]
[junit4:junit4]   2> 826 T1008 oass.SolrIndexSearcher.<init> Opening Searcher@1d529bc main
[junit4:junit4]   2> 826 T1008 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 827 T1008 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 827 T1008 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 827 T1008 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 830 T1008 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 849 T1009 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1d529bc main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 851 T1008 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 852 T1008 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 852 T988 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f03aeee0003 type:create cxid:0x53 zxid:0x2a txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 854 T1008 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 854 T1008 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:41009/solr shardId:control_shard
[junit4:junit4]   2> 854 T1008 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/control_shard/election
[junit4:junit4]   2> 858 T988 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f03aeee0003 type:delete cxid:0x62 zxid:0x31 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4]   2> 858 T1008 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 859 T988 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f03aeee0003 type:create cxid:0x63 zxid:0x32 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1288 T1006 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 1288 T1006 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:41009/solr",
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "shard":"control_shard",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:41009_solr",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "collection":"control_collection"}
[junit4:junit4]   2> 1289 T988 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f03aeee0003 type:create cxid:0x6a zxid:0x34 txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 1294 T1005 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 1360 T1008 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 1361 T1008 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 1361 T1008 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:41009/solr/collection1/
[junit4:junit4]   2> 1361 T1008 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 1362 T1008 oasc.SyncStrategy.syncToMe http://127.0.0.1:41009/solr/collection1/ has no replicas
[junit4:junit4]   2> 1362 T1008 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:41009/solr/collection1/
[junit4:junit4]   2> 1362 T1008 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/control_shard
[junit4:junit4]   2> 1365 T988 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f03aeee0003 type:create cxid:0x89 zxid:0x3f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1798 T1006 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 1802 T1005 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 1817 T1008 oasc.ZkController.register We are http://127.0.0.1:41009/solr/collection1/ and leader is http://127.0.0.1:41009/solr/collection1/
[junit4:junit4]   2> 1817 T1008 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:41009/solr
[junit4:junit4]   2> 1818 T1008 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 1818 T1008 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 1818 T1008 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 1820 T1008 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 1821 T983 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 1821 T983 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 1822 T983 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 1880 T983 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 1882 T983 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:45236
[junit4:junit4]   2> 1883 T983 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 1884 T983 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355314083336
[junit4:junit4]   2> 1884 T983 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355314083336/'
[junit4:junit4]   2> 1897 T983 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 1898 T983 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 1898 T983 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355314083336
[junit4:junit4]   2> 1899 T983 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355314083336/solr.xml
[junit4:junit4]   2> 1899 T983 oasc.CoreContainer.<init> New CoreContainer 33476917
[junit4:junit4]   2> 1900 T983 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355314083336/'
[junit4:junit4]   2> 1900 T983 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355314083336/'
[junit4:junit4]   2> 1914 T983 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 1924 T983 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:60056/solr
[junit4:junit4]   2> 1925 T983 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 1925 T983 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60056 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@bb132d
[junit4:junit4]   2> 1927 T1019 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:60056. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 1926 T983 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 1927 T1019 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:60056, initiating session
[junit4:junit4]   2> 1927 T985 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:40952
[junit4:junit4]   2> 1927 T985 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:40952
[junit4:junit4]   2> 1928 T987 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8f03aeee0004 with negotiated timeout 20000 for client /127.0.0.1:40952
[junit4:junit4]   2> 1928 T1019 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:60056, sessionid = 0x13b8f03aeee0004, negotiated timeout = 20000
[junit4:junit4]   2> 1928 T1020 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@bb132d name:ZooKeeperConnection Watcher:127.0.0.1:60056 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 1929 T983 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 1929 T988 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8f03aeee0004
[junit4:junit4]   2> 1930 T1020 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 1930 T985 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:40952 which had sessionid 0x13b8f03aeee0004
[junit4:junit4]   2> 1930 T983 oaz.ZooKeeper.close Session: 0x13b8f03aeee0004 closed
[junit4:junit4]   2> 1930 T983 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60056/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@1f5f367
[junit4:junit4]   2> 1931 T1021 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:60056. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 1931 T983 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 1932 T1021 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:60056, initiating session
[junit4:junit4]   2> 1932 T985 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:40953
[junit4:junit4]   2> 1932 T985 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:40953
[junit4:junit4]   2> 1933 T987 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8f03aeee0005 with negotiated timeout 8000 for client /127.0.0.1:40953
[junit4:junit4]   2> 1933 T1021 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:60056, sessionid = 0x13b8f03aeee0005, negotiated timeout = 8000
[junit4:junit4]   2> 1933 T1022 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f5f367 name:ZooKeeperConnection Watcher:127.0.0.1:60056/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 1933 T983 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 1934 T988 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f03aeee0005 type:create cxid:0x1 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1934 T988 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f03aeee0005 type:create cxid:0x2 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1935 T983 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45236_solr
[junit4:junit4]   2> 1936 T988 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f03aeee0005 type:delete cxid:0x4 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:45236_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:45236_solr
[junit4:junit4]   2> 1936 T983 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:45236_solr
[junit4:junit4]   2> 1938 T1005 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 1938 T1005 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 1938 T983 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 1939 T983 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 1939 T983 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 1940 T983 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 1940 T983 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 1940 T983 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 1941 T983 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 1941 T983 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 1942 T983 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 1942 T983 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 1947 T983 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 1952 T1023 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355314083336/collection1
[junit4:junit4]   2> 1953 T1023 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 1953 T1023 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 1953 T1023 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 1954 T1023 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355314083336/collection1/'
[junit4:junit4]   2> 1955 T1023 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty1-1355314083336/collection1/lib/README' to classloader
[junit4:junit4]   2> 1955 T1023 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty1-1355314083336/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 1987 T1023 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 2031 T1023 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 2032 T1023 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 2036 T1023 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 2304 T1006 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2305 T1006 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:41009/solr",
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "shard":"control_shard",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:41009_solr",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "collection":"control_collection"}
[junit4:junit4]   2> 2308 T1005 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 2308 T1022 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 2420 T1023 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 2426 T1023 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 2429 T1023 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 2438 T1023 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 2441 T1023 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 2443 T1023 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 2444 T1023 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 2445 T1023 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355314083336/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355314081515/jetty1/
[junit4:junit4]   2> 2446 T1023 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@78f54
[junit4:junit4]   2> 2446 T1023 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355314081515/jetty1/index/
[junit4:junit4]   2> 2446 T1023 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355314081515/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 2447 T1023 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355314081515/jetty1/index forceNew:false
[junit4:junit4]   2> 2481 T1023 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355314081515/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3b589c; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 2482 T1023 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 2482 T1023 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 2484 T1023 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 2484 T1023 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 2484 T1023 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 2484 T1023 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 2485 T1023 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 2485 T1023 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 2485 T1023 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 2486 T1023 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 2487 T1023 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 2487 T1023 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 2488 T1023 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 2488 T1023 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 2489 T1023 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 2489 T1023 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 2490 T1023 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 2490 T1023 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 2491 T1023 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2492 T1023 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2492 T1023 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2493 T1023 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2494 T1023 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2494 T1023 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2495 T1023 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2496 T1023 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 2497 T1023 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 2499 T1023 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 2501 T1023 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 2502 T1023 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, STOPWORDS.TXT, MAPPING-ISOLATIN1ACCENT.TXT, SYNONYMS.TXT, OLD_SYNONYMS.TXT, CURRENCY.XML, OPEN-EXCHANGE-RATES.JSON, PROTWORDS.TXT]
[junit4:junit4]   2> 2504 T1023 oass.SolrIndexSearcher.<init> Opening Searcher@186016a main
[junit4:junit4]   2> 2504 T1023 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 2505 T1023 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 2505 T1023 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 2506 T1023 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 2509 T1023 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 2529 T1024 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@186016a main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 2534 T1023 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 2535 T1023 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 2812 T1006 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2812 T1006 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:45236/solr",
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:45236_solr",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "collection":"collection1"}
[junit4:junit4]   2> 2813 T1006 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4]   2> 2813 T1006 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 2816 T1005 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 2816 T1022 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3037 T1023 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 3037 T1023 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:45236/solr shardId:shard1
[junit4:junit4]   2> 3038 T1023 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 3043 T988 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f03aeee0005 type:delete cxid:0x45 zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 3044 T1023 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 3044 T988 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f03aeee0005 type:create cxid:0x46 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3046 T1023 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 3046 T1023 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 3046 T1023 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:45236/solr/collection1/
[junit4:junit4]   2> 3046 T1023 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 3047 T1023 oasc.SyncStrategy.syncToMe http://127.0.0.1:45236/solr/collection1/ has no replicas
[junit4:junit4]   2> 3047 T1023 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:45236/solr/collection1/
[junit4:junit4]   2> 3047 T1023 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 3050 T988 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f03aeee0005 type:create cxid:0x50 zxid:0x60 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3319 T1006 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3336 T1022 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3336 T1005 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3351 T1023 oasc.ZkController.register We are http://127.0.0.1:45236/solr/collection1/ and leader is http://127.0.0.1:45236/solr/collection1/
[junit4:junit4]   2> 3352 T1023 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:45236/solr
[junit4:junit4]   2> 3352 T1023 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 3352 T1023 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 3352 T1023 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 3353 T1023 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3354 T983 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 3355 T983 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 3355 T983 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 3413 T983 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 3415 T983 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:46070
[junit4:junit4]   2> 3416 T983 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 3416 T983 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355314084871
[junit4:junit4]   2> 3416 T983 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355314084871/'
[junit4:junit4]   2> 3429 T983 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 3430 T983 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 3430 T983 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355314084871
[junit4:junit4]   2> 3431 T983 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355314084871/solr.xml
[junit4:junit4]   2> 3431 T983 oasc.CoreContainer.<init> New CoreContainer 28337672
[junit4:junit4]   2> 3431 T983 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355314084871/'
[junit4:junit4]   2> 3432 T983 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355314084871/'
[junit4:junit4]   2> 3446 T983 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 3456 T983 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:60056/solr
[junit4:junit4]   2> 3456 T983 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 3457 T983 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60056 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@d3dc6b
[junit4:junit4]   2> 3458 T1034 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:60056. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 3458 T983 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3458 T1034 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:60056, initiating session
[junit4:junit4]   2> 3458 T985 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:40954
[junit4:junit4]   2> 3459 T985 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:40954
[junit4:junit4]   2> 3459 T987 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8f03aeee0006 with negotiated timeout 20000 for client /127.0.0.1:40954
[junit4:junit4]   2> 3459 T1034 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:60056, sessionid = 0x13b8f03aeee0006, negotiated timeout = 20000
[junit4:junit4]   2> 3460 T1035 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d3dc6b name:ZooKeeperConnection Watcher:127.0.0.1:60056 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3460 T983 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3461 T988 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8f03aeee0006
[junit4:junit4]   2> 3461 T1035 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 3461 T985 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:40954 which had sessionid 0x13b8f03aeee0006
[junit4:junit4]   2> 3461 T983 oaz.ZooKeeper.close Session: 0x13b8f03aeee0006 closed
[junit4:junit4]   2> 3462 T983 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60056/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@1633d25
[junit4:junit4]   2> 3463 T1036 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:60056. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 3463 T983 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3463 T1036 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:60056, initiating session
[junit4:junit4]   2> 3463 T985 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:40955
[junit4:junit4]   2> 3464 T985 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:40955
[junit4:junit4]   2> 3464 T987 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8f03aeee0007 with negotiated timeout 8000 for client /127.0.0.1:40955
[junit4:junit4]   2> 3464 T1036 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:60056, sessionid = 0x13b8f03aeee0007, negotiated timeout = 8000
[junit4:junit4]   2> 3464 T1037 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1633d25 name:ZooKeeperConnection Watcher:127.0.0.1:60056/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3465 T983 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3465 T988 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f03aeee0007 type:create cxid:0x1 zxid:0x6d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3466 T988 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f03aeee0007 type:create cxid:0x2 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3466 T983 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46070_solr
[junit4:junit4]   2> 3467 T988 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f03aeee0007 type:delete cxid:0x4 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:46070_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:46070_solr
[junit4:junit4]   2> 3467 T983 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:46070_solr
[junit4:junit4]   2> 3469 T1005 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 3469 T1022 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 3469 T1005 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 3469 T1022 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 3469 T983 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 3470 T983 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 3470 T983 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 3471 T983 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 3471 T983 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 3471 T983 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 3472 T983 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 3472 T983 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 3473 T983 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 3473 T983 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 3478 T983 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3483 T1038 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355314084871/collection1
[junit4:junit4]   2> 3483 T1038 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 3484 T1038 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 3484 T1038 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 3484 T1038 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355314084871/collection1/'
[junit4:junit4]   2> 3485 T1038 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty2-1355314084871/collection1/lib/README' to classloader
[junit4:junit4]   2> 3485 T1038 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty2-1355314084871/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 3516 T1038 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 3560 T1038 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 3561 T1038 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 3565 T1038 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 3839 T1006 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3840 T1006 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:45236/solr",
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:45236_solr",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "collection":"collection1"}
[junit4:junit4]   2> 3842 T1005 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 3842 T1022 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 3843 T1037 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 3964 T1038 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 3970 T1038 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 3973 T1038 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 3982 T1038 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 3985 T1038 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 3989 T1038 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 3990 T1038 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 3991 T1038 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355314084871/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355314081515/jetty2/
[junit4:junit4]   2> 3991 T1038 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@78f54
[junit4:junit4]   2> 3992 T1038 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355314081515/jetty2/index/
[junit4:junit4]   2> 3992 T1038 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355314081515/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 3992 T1038 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355314081515/jetty2/index forceNew:false
[junit4:junit4]   2> 3996 T1038 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355314081515/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@109c7e5; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 3996 T1038 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 3997 T1038 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 3998 T1038 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 3998 T1038 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 3999 T1038 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 3999 T1038 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 3999 T1038 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 4000 T1038 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 4000 T1038 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 4001 T1038 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 4001 T1038 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 4002 T1038 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 4003 T1038 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 4003 T1038 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 4004 T1038 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 4004 T1038 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 4004 T1038 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 4005 T1038 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 4006 T1038 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4006 T1038 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4007 T1038 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4008 T1038 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4008 T1038 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4009 T1038 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4010 T1038 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4010 T1038 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 4011 T1038 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 4013 T1038 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 4015 T1038 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 4016 T1038 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, STOPWORDS.TXT, MAPPING-ISOLATIN1ACCENT.TXT, SYNONYMS.TXT, OLD_SYNONYMS.TXT, CURRENCY.XML, OPEN-EXCHANGE-RATES.JSON, PROTWORDS.TXT]
[junit4:junit4]   2> 4018 T1038 oass.SolrIndexSearcher.<init> Opening Searcher@1253899 main
[junit4:junit4]   2> 4018 T1038 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 4019 T1038 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 4019 T1038 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 4020 T1038 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 4023 T1038 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 4042 T1039 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1253899 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 4048 T1038 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 4048 T1038 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 4345 T1006 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4346 T1006 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:46070/solr",
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:46070_solr",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "collection":"collection1"}
[junit4:junit4]   2> 4346 T1006 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 4346 T1006 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4]   2> 4360 T1022 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4360 T1037 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4360 T1005 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4550 T1038 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 4550 T1038 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:46070/solr shardId:shard2
[junit4:junit4]   2> 4551 T1038 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4]   2> 4555 T988 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f03aeee0007 type:delete cxid:0x44 zxid:0x7e txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard2 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard2
[junit4:junit4]   2> 4556 T1038 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 4556 T988 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f03aeee0007 type:create cxid:0x45 zxid:0x7f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4558 T1038 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 4558 T1038 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 4559 T1038 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:46070/solr/collection1/
[junit4:junit4]   2> 4559 T1038 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 4559 T1038 oasc.SyncStrategy.syncToMe http://127.0.0.1:46070/solr/collection1/ has no replicas
[junit4:junit4]   2> 4560 T1038 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:46070/solr/collection1/
[junit4:junit4]   2> 4560 T1038 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4]   2> 4563 T988 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f03aeee0007 type:create cxid:0x4e zxid:0x82 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4864 T1006 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4871 T1037 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4871 T1005 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4871 T1022 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4916 T1038 oasc.ZkController.register We are http://127.0.0.1:46070/solr/collection1/ and leader is http://127.0.0.1:46070/solr/collection1/
[junit4:junit4]   2> 4916 T1038 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:46070/solr
[junit4:junit4]   2> 4916 T1038 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 4916 T1038 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 4917 T1038 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 4918 T1038 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4918 T983 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 4919 T983 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 4920 T983 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 4975 T983 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 4978 T983 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:60354
[junit4:junit4]   2> 4979 T983 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 4979 T983 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355314086434
[junit4:junit4]   2> 4980 T983 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355314086434/'
[junit4:junit4]   2> 4993 T983 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 4994 T983 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 4994 T983 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355314086434
[junit4:junit4]   2> 4995 T983 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355314086434/solr.xml
[junit4:junit4]   2> 4995 T983 oasc.CoreContainer.<init> New CoreContainer 8699770
[junit4:junit4]   2> 4996 T983 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355314086434/'
[junit4:junit4]   2> 4996 T983 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355314086434/'
[junit4:junit4]   2> 5011 T983 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 5022 T983 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:60056/solr
[junit4:junit4]   2> 5022 T983 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 5023 T983 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60056 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@ef2492
[junit4:junit4]   2> 5024 T1049 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:60056. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 5024 T983 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 5024 T1049 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:60056, initiating session
[junit4:junit4]   2> 5024 T985 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:40956
[junit4:junit4]   2> 5025 T985 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:40956
[junit4:junit4]   2> 5025 T987 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8f03aeee0008 with negotiated timeout 20000 for client /127.0.0.1:40956
[junit4:junit4]   2> 5025 T1049 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:60056, sessionid = 0x13b8f03aeee0008, negotiated timeout = 20000
[junit4:junit4]   2> 5026 T1050 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ef2492 name:ZooKeeperConnection Watcher:127.0.0.1:60056 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 5026 T983 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 5027 T988 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8f03aeee0008
[junit4:junit4]   2> 5027 T985 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:40956 which had sessionid 0x13b8f03aeee0008
[junit4:junit4]   2> 5027 T1050 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 5027 T983 oaz.ZooKeeper.close Session: 0x13b8f03aeee0008 closed
[junit4:junit4]   2> 5028 T983 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60056/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@e30300
[junit4:junit4]   2> 5029 T983 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 5029 T1051 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:60056. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 5030 T1051 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:60056, initiating session
[junit4:junit4]   2> 5030 T985 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:40957
[junit4:junit4]   2> 5030 T985 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:40957
[junit4:junit4]   2> 5031 T987 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8f03aeee0009 with negotiated timeout 8000 for client /127.0.0.1:40957
[junit4:junit4]   2> 5031 T1051 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:60056, sessionid = 0x13b8f03aeee0009, negotiated timeout = 8000
[junit4:junit4]   2> 5031 T1052 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e30300 name:ZooKeeperConnection Watcher:127.0.0.1:60056/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 5032 T983 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 5032 T988 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f03aeee0009 type:create cxid:0x1 zxid:0x8f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5033 T988 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f03aeee0009 type:create cxid:0x2 zxid:0x90 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5034 T983 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60354_solr
[junit4:junit4]   2> 5034 T988 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f03aeee0009 type:delete cxid:0x4 zxid:0x91 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:60354_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:60354_solr
[junit4:junit4]   2> 5035 T983 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:60354_solr
[junit4:junit4]   2> 5036 T1037 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5036 T1022 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5037 T1005 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 5037 T1005 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5038 T1037 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 5038 T1022 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 5038 T983 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 5039 T983 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 5039 T983 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 5039 T983 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 5040 T983 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 5040 T983 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 5041 T983 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 5041 T983 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 5041 T983 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 5042 T983 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 5048 T983 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 5054 T1053 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355314086434/collection1
[junit4:junit4]   2> 5055 T1053 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 5055 T1053 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 5055 T1053 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 5056 T1053 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355314086434/collection1/'
[junit4:junit4]   2> 5057 T1053 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty3-1355314086434/collection1/lib/README' to classloader
[junit4:junit4]   2> 5057 T1053 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty3-1355314086434/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 5100 T1053 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 5157 T1053 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 5158 T1053 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 5163 T1053 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 5376 T1006 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5377 T1006 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:46070/solr",
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:46070_solr",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "collection":"collection1"}
[junit4:junit4]   2> 5379 T1052 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5380 T1022 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5380 T1005 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5380 T1037 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5571 T1053 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 5577 T1053 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 5580 T1053 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 5590 T1053 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5593 T1053 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5596 T1053 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5597 T1053 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5598 T1053 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355314086434/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355314081515/jetty3/
[junit4:junit4]   2> 5598 T1053 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@78f54
[junit4:junit4]   2> 5598 T1053 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355314081515/jetty3/index/
[junit4:junit4]   2> 5599 T1053 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355314081515/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 5599 T1053 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355314081515/jetty3/index forceNew:false
[junit4:junit4]   2> 5602 T1053 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355314081515/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@204899; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 5603 T1053 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 5604 T1053 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 5605 T1053 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 5606 T1053 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 5606 T1053 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 5607 T1053 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 5607 T1053 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 5608 T1053 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 5608 T1053 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 5609 T1053 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 5611 T1053 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 5612 T1053 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 5613 T1053 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 5613 T1053 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 5614 T1053 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 5614 T1053 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 5614 T1053 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 5615 T1053 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 5616 T1053 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5617 T1053 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5617 T1053 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5618 T1053 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5619 T1053 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5620 T1053 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5620 T1053 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5621 T1053 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 5622 T1053 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 5624 T1053 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 5626 T1053 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 5627 T1053 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, STOPWORDS.TXT, MAPPING-ISOLATIN1ACCENT.TXT, SYNONYMS.TXT, OLD_SYNONYMS.TXT, CURRENCY.XML, OPEN-EXCHANGE-RATES.JSON, PROTWORDS.TXT]
[junit4:junit4]   2> 5629 T1053 oass.SolrIndexSearcher.<init> Opening Searcher@121067f main
[junit4:junit4]   2> 5629 T1053 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 5630 T1053 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 5630 T1053 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 5631 T1053 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 5634 T1053 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 5656 T1054 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@121067f main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 5662 T1053 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 5663 T1053 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 5884 T1006 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5885 T1006 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:60354/solr",
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:60354_solr",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "collection":"collection1"}
[junit4:junit4]   2> 5885 T1006 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 5885 T1006 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 5888 T1005 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5888 T1022 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5888 T1052 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5888 T1037 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6164 T1053 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 6164 T1053 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:60354/solr shardId:shard1
[junit4:junit4]   2> 6182 T1053 oasc.ZkController.register We are http://127.0.0.1:60354/solr/collection1/ and leader is http://127.0.0.1:45236/solr/collection1/
[junit4:junit4]   2> 6182 T1053 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:60354/solr
[junit4:junit4]   2> 6183 T1053 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 6183 T1053 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C56 name=collection1 org.apache.solr.core.SolrCore@eef363 url=http://127.0.0.1:60354/solr/collection1 node=127.0.0.1:60354_solr
[junit4:junit4]   2> 6186 T1055 C56 P60354 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 6186 T1053 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6187 T1055 C56 P60354 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 6187 T1055 C56 P60354 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 6188 T1055 C56 P60354 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 6188 T983 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 6188 T983 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 6189 T983 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 6201 T1055 C56 P60354 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:45236/solr/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 6204 T1055 C56 P60354 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4]   2> 6208 T1055 C56 P60354 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:60354/solr START replicas=[http://127.0.0.1:45236/solr/collection1/] nUpdates=100
[junit4:junit4]   2> 6209 T1055 C56 P60354 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 6210 T1055 C56 P60354 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 6210 T1055 C56 P60354 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 6210 T1055 C56 P60354 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C57 name=collection1 org.apache.solr.core.SolrCore@b19775 url=http://127.0.0.1:45236/solr/collection1 node=127.0.0.1:45236_solr
[junit4:junit4]   2> 6215 T1018 C57 P45236 REQ /get {wt=javabin&getVersions=100&qt=/get&version=2&distrib=false} status=0 QTime=1 
[junit4:junit4]   2> 6252 T983 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 6254 T983 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:37697
[junit4:junit4]   2> 6254 T983 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 6255 T983 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355314087705
[junit4:junit4]   2> 6255 T983 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355314087705/'
[junit4:junit4]   2> 6268 T983 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 6269 T983 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 6269 T983 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355314087705
[junit4:junit4]   2> 6270 T983 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355314087705/solr.xml
[junit4:junit4]   2> 6270 T983 oasc.CoreContainer.<init> New CoreContainer 10119758
[junit4:junit4]   2> 6271 T983 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355314087705/'
[junit4:junit4]   2> 6271 T983 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355314087705/'
[junit4:junit4]   2> 6285 T983 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 6295 T983 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:60056/solr
[junit4:junit4]   2> 6296 T983 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 6296 T983 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60056 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@14bf24d
[junit4:junit4]   2> 6297 T983 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6297 T1066 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:60056. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 6298 T1066 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:60056, initiating session
[junit4:junit4]   2> 6298 T985 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:40960
[junit4:junit4]   2> 6298 T985 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:40960
[junit4:junit4]   2> 6301 T987 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8f03aeee000a with negotiated timeout 20000 for client /127.0.0.1:40960
[junit4:junit4]   2> 6301 T1066 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:60056, sessionid = 0x13b8f03aeee000a, negotiated timeout = 20000
[junit4:junit4]   2> 6302 T1067 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14bf24d name:ZooKeeperConnection Watcher:127.0.0.1:60056 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6302 T983 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6303 T988 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8f03aeee000a
[junit4:junit4]   2> 6304 T1067 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 6305 T985 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:40960 which had sessionid 0x13b8f03aeee000a
[junit4:junit4]   2> 6304 T983 oaz.ZooKeeper.close Session: 0x13b8f03aeee000a closed
[junit4:junit4]   2> 6305 T983 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60056/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@1a7d5ce
[junit4:junit4]   2> 6306 T983 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6306 T1068 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:60056. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 6307 T1068 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:60056, initiating session
[junit4:junit4]   2> 6307 T985 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:40961
[junit4:junit4]   2> 6307 T985 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:40961
[junit4:junit4]   2> 6308 T987 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8f03aeee000b with negotiated timeout 8000 for client /127.0.0.1:40961
[junit4:junit4]   2> 6308 T1068 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:60056, sessionid = 0x13b8f03aeee000b, negotiated timeout = 8000
[junit4:junit4]   2> 6308 T1069 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1a7d5ce name:ZooKeeperConnection Watcher:127.0.0.1:60056/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6308 T983 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6309 T988 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f03aeee000b type:create cxid:0x1 zxid:0xa2 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6310 T988 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f03aeee000b type:create cxid:0x2 zxid:0xa3 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6311 T983 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37697_solr
[junit4:junit4]   2> 6311 T988 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8f03aeee000b type:delete cxid:0x4 zxid:0xa4 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:37697_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:37697_solr
[junit4:junit4]   2> 6312 T983 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:37697_solr
[junit4:junit4]   2> 6313 T1037 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6314 T1022 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 6314 T1005 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 6314 T1052 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 6314 T1022 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6314 T1005 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6314 T1052 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6315 T1037 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 6315 T983 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 6316 T983 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 6316 T983 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 6317 T983 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 6317 T983 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 6317 T983 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 6318 T983 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 6318 T983 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 6318 T983 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 6319 T983 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 6324 T983 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 6329 T1070 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355314087705/collection1
[junit4:junit4]   2> 6330 T1070 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 6330 T1070 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 6330 T1070 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 6331 T1070 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355314087705/collection1/'
[junit4:junit4]   2> 6331 T1070 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty4-1355314087705/collection1/lib/README' to classloader
[junit4:junit4]   2> 6332 T1070 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty4-1355314087705/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 6365 T1070 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 6391 T1006 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6392 T1006 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:60354/solr",
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:60354_solr",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "collection":"collection1"}
[junit4:junit4]   2> 6411 T1070 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 6440 T1052 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6440 T1022 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6440 T1069 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6440 T1070 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 6440 T1037 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6440 T1005 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6447 T1070 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 6842 T1070 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 6848 T1070 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 6850 T1070 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 6859 T1070 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 6862 T1070 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 6866 T1070 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 6867 T1070 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 6868 T1070 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355314087705/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355314081515/jetty4/
[junit4:junit4]   2> 6868 T1070 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@78f54
[junit4:junit4]   2> 6868 T1070 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355314081515/jetty4/index/
[junit4:junit4]   2> 6869 T1070 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355314081515/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 6869 T1070 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355314081515/jetty4/index forceNew:false
[junit4:junit4]   2> 6872 T1070 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355314081515/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@b218c8; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 6872 T1070 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 6873 T1070 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 6874 T1070 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 6874 T1070 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 6875 T1070 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 6875 T1070 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 6875 T1070 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 6876 T1070 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 6876 T1070 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 6877 T1070 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 6878 T1070 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 6878 T1070 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 6879 T1070 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 6879 T1070 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 6880 T1070 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 6880 T1070 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 6881 T1070 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 6882 T1070 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 6883 T1070 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6884 T1070 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6886 T1070 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6887 T1070 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6888 T1070 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6889 T1070 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6890 T1070 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6891 T1070 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 6892 T1070 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 6894 T1070 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 6896 T1070 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 6897 T1070 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, STOPWORDS.TXT, MAPPING-ISOLATIN1ACCENT.TXT, SYNONYMS.TXT, OLD_SYNONYMS.TXT, CURRENCY.XML, OPEN-EXCHANGE-RATES.JSON, PROTWORDS.TXT]
[junit4:junit4]   2> 6899 T1070 oass.SolrIndexSearcher.<init> Opening Searcher@1cb2caf main
[junit4:junit4]   2> 6899 T1070 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 6900 T1070 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 6900 T1070 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 6901 T1070 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 6904 T1070 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 6923 T1071 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1cb2caf main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 6928 T1070 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 6929 T1070 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 6946 T1006 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6946 T1006 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:37697/solr",
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:37697_solr",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "collection":"collection1"}
[junit4:junit4]   2> 6947 T1006 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 6947 T1006 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4]   2> 6949 T1069 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6949 T1022 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6949 T1005 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6950 T1052 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6949 T1037 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7430 T1070 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 7431 T1070 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:37697/solr shardId:shard2
[junit4:junit4]   2> 7433 T1070 oasc.ZkController.register We are http://127.0.0.1:37697/solr/collection1/ and leader is http://127.0.0.1:46070/solr/collection1/
[junit4:junit4]   2> 7434 T1070 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:37697/solr
[junit4:junit4]   2> 7434 T1070 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 7434 T1070 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C58 name=collection1 org.apache.solr.core.SolrCore@a8cda6 url=http://127.0.0.1:37697/solr/collection1 node=127.0.0.1:37697_solr
[junit4:junit4]   2> 7434 T1072 C58 P37697 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 7435 T1070 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7435 T1072 C58 P37697 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 7435 T1072 C58 P37697 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 7435 T1072 C58 P37697 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 7436 T983 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 7436 T1072 C58 P37697 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:46070/solr/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 7436 T1072 C58 P37697 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:37697/solr START replicas=[http://127.0.0.1:46070/solr/collection1/] nUpdates=100
[junit4:junit4]   2> 7436 T983 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 7437 T1072 C58 P37697 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 7437 T983 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 7437 T1072 C58 P37697 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 7437 T1072 C58 P37697 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 7438 T1072 C58 P37697 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 7441 T983 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60056/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@a12f10
[junit4:junit4]   2> ASYNC  NEW_CORE C59 name=collection1 org.apache.solr.core.SolrCore@13a7fa6 url=http://127.0.0.1:46070/solr/collection1 node=127.0.0.1:46070_solr
[junit4:junit4]   2> 7441 T1030 C59 P46070 REQ /get {wt=javabin&getVersions=100&qt=/get&version=2&distrib=false} status=0 QTime=0 
[junit4:junit4]   2> 7442 T983 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 7442 T1074 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:60056. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 7443 T1074 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:60056, initiating session
[junit4:junit4]   2> 7443 T985 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:40973
[junit4:junit4]   2> 7443 T985 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:40973
[junit4:junit4]   2> 7444 T987 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8f03aeee000c with negotiated timeout 10000 for client /127.0.0.1:40973
[junit4:junit4]   2> 7444 T1074 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:60056, sessionid = 0x13b8f03aeee000c, negotiated timeout = 10000
[junit4:junit4]   2> 7444 T1075 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a12f10 name:ZooKeeperConnection Watcher:127.0.0.1:60056/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 7444 T983 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 7445 T983 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 7448 T983 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 7449 T983 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 7452 T983 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7453 T1006 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7453 T1006 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:37697/solr",
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:37697_solr",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "collection":"collection1"}
[junit4:junit4]   2> 7453 T983 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):540
[junit4:junit4]   2> 7454 T983 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7456 T1037 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7456 T1022 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7456 T1075 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7456 T1069 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7456 T1052 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7456 T1005 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8456 T983 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2>  C56_STATE=coll:collection1 core:collection1 props:{roles=null, core=collection1, base_url=http://127.0.0.1:60354/solr, state=recovering, shard=shard1, node_name=127.0.0.1:60354_solr, collection=collection1}
[junit4:junit4]   2> 9216 T1055 C56 P60354 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 9217 T1055 C56 P60354 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 9217 T1055 C56 P60354 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:45236/solr/collection1/. core=collection1
[junit4:junit4]   2> 9217 T1055 C56 P60354 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 9221 T1017 C57 P45236 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 9223 T1017 C57 P45236 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355314081515/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3b589c; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 9224 T1017 C57 P45236 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 9230 T1017 C57 P45236 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355314081515/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3b589c; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355314081515/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3b589c; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 9230 T1017 C57 P45236 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 9231 T1017 C57 P45236 oass.SolrIndexSearcher.<init> Opening Searcher@1156328 realtime
[junit4:junit4]   2> 9231 T1017 C57 P45236 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 9231 T1017 C57 P45236 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 9232 T1017 C57 P45236 /update {commit=true&softCommit=false&wt=javabin&commit_end_point=true&openSearcher=false&waitSearcher=true&version=2} {commit=} 0 12
[junit4:junit4]   2> 9233 T1055 C56 P60354 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 9233 T1055 C56 P60354 oascsi.HttpClientUtil.createClient Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
[junit4:junit4]   2> 9238 T1055 C56 P60354 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 9242 T1016 C57 P45236 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 9242 T1016 C57 P45236 REQ /replication {wt=javabin&command=indexversion&qt=/replication&version=2} status=0 QTime=3 
[junit4:junit4]   2> 9243 T1055 C56 P60354 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 9243 T1055 C56 P60354 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 9243 T1055 C56 P60354 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 9246 T1018 C57 P45236 REQ /replication {wt=javabin&command=filelist&generation=2&qt=/replication&version=2} status=0 QTime=1 
[junit4:junit4]   2> 9246 T1055 C56 P60354 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 9247 T1055 C56 P60354 oash.SnapPuller.fetchLatestIndex Starting download to ./org.apache.solr.cloud.BasicDistributedZkTest-1355314081515/jetty3/index.20121212090810758 fullCopy=true
[junit4:junit4]   2> 9252 T1017 C57 P45236 REQ /replication {generation=2&file=segments_2&wt=filestream&checksum=true&command=filecontent&qt=/replication} status=0 QTime=1 
[junit4:junit4]   2> 9257 T1055 C56 P60354 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 9260 T1055 C56 P60354 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20121212090810758
[junit4:junit4]   2> 9261 T1055 C56 P60354 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.BasicDistributedZkTest-1355314081515/jetty3/index/ new=./org.apache.solr.cloud.BasicDistributedZkTest-1355314081515/jetty3/index.20121212090810758
[junit4:junit4]   2> 9261 T1055 C56 P60354 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355314081515/jetty3/index.20121212090810758 forceNew:false
[junit4:junit4]   2> 9262 T1055 C56 P60354 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355314081515/jetty3/index.20121212090810758 lockFactory=org.apache.lucene.store.NativeFSLockFactory@9b3af6; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 9263 T1055 C56 P60354 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 9264 T1055 C56 P60354 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 9264 T1055 C56 P60354 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 9265 T1055 C56 P60354 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4]   2> 9265 T1055 C56 P60354 oasc.CachingDirectoryFactory.close Closing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355314081515/jetty3/index.20121212090810758
[junit4:junit4]   2> 9265 T1055 C56 P60354 oash.SnapPuller$2.onClose removing old index directory ./org.apache.solr.cloud.BasicDistributedZkTest-1355314081515/jetty3/index
[junit4:junit4]   2> 9266 T1055 C56 P60354 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355314081515/jetty3/index.20121212090810758 forceNew:true
[junit4:junit4]   2> 9267 T1055 C56 P60354 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355314081515/jetty3/index.20121212090810758 lockFactory=org.apache.lucene.store.NativeFSLockFactory@10f948c; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 9267 T1055 C56 P60354 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 9268 T1055 C56 P60354 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 9268 T1055 C56 P60354 oass.SolrIndexSearcher.<init> Opening Searcher@db9c2f main
[junit4:junit4]   2> 9268 T1055 C56 P60354 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 9270 T1054 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@db9c2f main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 9271 T1055 C56 P60354 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 9301 T1055 C56 P60354 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355314081515/jetty3/index.20121212090810758 lockFactory=org.apache.lucene.store.NativeFSLockFactory@10f948c; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355314081515/jetty3/index.20121212090810758 lockFactory=org.apache.lucene.store.NativeFSLockFactory@10f948c; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 9302 T1055 C56 P60354 oasc.SolrDeletionPolicy.updateCommits newest commit = 3
[junit4:junit4]   2> 9302 T1055 C56 P60354 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 9303 T1055 C56 P60354 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 9303 T1055 C56 P60354 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 9303 T1055 C56 P60354 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 9303 T1055 C56 P60354 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 9304 T1055 C56 P60354 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 9458 T983 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9463 T1006 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9464 T1006 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:60354/solr",
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:60354_solr",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "collection":"collection1"}
[junit4:junit4]   2> 9466 T1075 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9466 T1069 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9467 T1037 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9467 T1022 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9467 T1005 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9466 T1052 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2>  C58_STATE=coll:collection1 core:collection1 props:{roles=null, core=collection1, base_url=http://127.0.0.1:37697/solr, state=recovering, shard=shard2, node_name=127.0.0.1:37697_solr, collection=collection1}
[junit4:junit4]   2> 10441 T1072 C58 P37697 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 10442 T1072 C58 P37697 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 10442 T1072 C58 P37697 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:46070/solr/collection1/. core=collection1
[junit4:junit4]   2> 10442 T1072 C58 P37697 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 10446 T1032 C59 P46070 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 10448 T1032 C59 P46070 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355314081515/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@109c7e5; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 10449 T1032 C59 P46070 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 10459 T983 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10470 T1032 C59 P46070 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355314081515/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@109c7e5; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355314081515/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@109c7e5; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 10470 T1032 C59 P46070 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 10471 T1032 C59 P46070 oass.SolrIndexSearcher.<init> Opening Searcher@2e3cae realtime
[junit4:junit4]   2> 10471 T1032 C59 P46070 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 10472 T1032 C59 P46070 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 10472 T1032 C59 P46070 /update {commit=true&softCommit=false&wt=javabin&commit_end_point=true&openSearcher=false&waitSearcher=true&version=2} {commit=} 0 26
[junit4:junit4]   2> 10473 T1072 C58 P37697 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 10473 T1072 C58 P37697 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 10475 T1031 C59 P46070 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 10475 T1031 C59 P46070 REQ /replication {wt=javabin&command=indexversion&qt=/replication&version=2} status=0 QTime=1 
[junit4:junit4]   2> 10476 T1072 C58 P37697 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 10476 T1072 C58 P37697 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 10476 T1072 C58 P37697 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 10478 T1032 C59 P46070 REQ /replication {wt=javabin&command=filelist&generation=2&qt=/replication&version=2} status=0 QTime=0 
[junit4:junit4]   2> 10479 T1072 C58 P37697 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 10479 T1072 C58 P37697 oash.SnapPuller.fetchLatestIndex Starting download to ./org.apache.solr.cloud.BasicDistributedZkTest-1355314081515/jetty4/index.20121212090811990 fullCopy=true
[junit4:junit4]   2> 10481 T1033 C59 P46070 REQ /replication {generation=2&file=segments_2&wt=filestream&checksum=true&command=filecontent&qt=/replication} status=0 QTime=0 
[junit4:junit4]   2> 10483 T1072 C58 P37697 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 10490 T1072 C58 P37697 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20121212090811990
[junit4:junit4]   2> 10490 T1072 C58 P37697 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.BasicDistributedZkTest-1355314081515/jetty4/index/ new=./org.apache.solr.cloud.BasicDistributedZkTest-1355314081515/jetty4/index.20121212090811990
[junit4:junit4]   2> 10491 T1072 C58 P37697 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355314081515/jetty4/index.20121212090811990 forceNew:false
[junit4:junit4]   2> 10492 T1072 C58 P37697 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355314081515/jetty4/index.20121212090811990 lockFactory=org.apache.lucene.store.NativeFSLockFactory@bf314f; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 10492 T1072 C58 P37697 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 10493 T1072 C58 P37697 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 10493 T1072 C58 P37697 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 10493 T1072 C58 P37697 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4]   2> 10493 T1072 C58 P37697 oasc.CachingDirectoryFactory.close Closing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355314081515/jetty4/index.20121212090811990
[junit4:junit4]   2> 10494 T1072 C58 P37697 oash.SnapPuller$2.onClose removing old index directory ./org.apache.solr.cloud.BasicDistributedZkTest-1355314081515/jetty4/index
[junit4:junit4]   2> 10494 T1072 C58 P37697 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355314081515/jetty4/index.20121212090811990 forceNew:true
[junit4:junit4]   2> 10495 T1072 C58 P37697 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355314081515/jetty4/index.20121212090811990 lockFactory=org.apache.lucene.store.NativeFSLockFactory@143c4ad; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 10496 T1072 C58 P37697 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 10496 T1072 C58 P37697 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 10496 T1072 C58 P37697 oass.SolrIndexSearcher.<init> Opening Searcher@23ef54 main
[junit4:junit4]   2> 10496 T1072 C58 P37697 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 10498 T1071 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@23ef54 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 10498 T1072 C58 P37697 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 10531 T1072 C58 P37697 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355314081515/jetty4/index.20121212090811990 lockFactory=org.apache.lucene.store.NativeFSLockFactory@143c4ad; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355314081515/jetty4/index.20121212090811990 lockFactory=org.apache.lucene.store.NativeFSLockFactory@143c4ad; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 10532 T1072 C58 P37697 oasc.SolrDeletionPolicy.updateCommits newest commit = 3
[junit4:junit4]   2> 10532 T1072 C58 P37697 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 10532 T1072 C58 P37697 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 10533 T1072 C58 P37697 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 10533 T1072 C58 P37697 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 10533 T1072 C58 P37697 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 10534 T1072 C58 P37697 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 10973 T1006 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10974 T1006 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:37697/solr",
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:37697_solr",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "collection":"collection1"}
[junit4:junit4]   2> 10979 T1052 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10979 T1022 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10980 T1069 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10980 T1037 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10980 T1075 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10980 T1005 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 11461 T983 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> ASYNC  NEW_CORE C60 name=collection1 org.apache.solr.core.SolrCore@28c7cc url=http://127.0.0.1:41009/solr/collection1 node=127.0.0.1:41009_solr
[junit4:junit4]   2> 11469 T1001 C60 P41009 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355314081515/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@fab11b; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 11470 T1001 C60 P41009 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 11470 T1001 C60 P41009 oass.SolrIndexSearcher.<init> Opening Searcher@1ad139 realtime
[junit4:junit4]   2> 11471 T1001 C60 P41009 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 11471 T1001 C60 P41009 /update {wt=javabin&version=2} {deleteByQuery=*:* (-1421149830358499328)} 0 4
[junit4:junit4]   2> 11472 T983 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60056/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@9e181d
[junit4:junit4]   2> 11473 T1078 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:60056. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 11473 T983 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 11473 T1078 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:60056, initiating session
[junit4:junit4]   2> 11473 T985 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:40984
[junit4:junit4]   2> 11474 T985 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:40984
[junit4:junit4]   2> 11475 T987 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8f03aeee000d with negotiated timeout 10000 for client /127.0.0.1:40984
[junit4:junit4]   2> 11475 T1078 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:60056, sessionid = 0x13b8f03aeee000d, negotiated timeout = 10000
[junit4:junit4]   2> 11476 T1079 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@9e181d name:ZooKeeperConnection Watcher:127.0.0.1:60056/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 11476 T983 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 11477 T983 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2>  C58_STATE=coll:collection1 core:collection1 props:{roles=null, core=collection1, base_url=http://127.0.0.1:37697/solr, state=active, shard=shard2, node_name=127.0.0.1:37697_solr, collection=collection1}
[junit4:junit4]   2> 11487 T1064 C58 P37697 REQ /update {_version_=-1421149830373179392&update.from=http://127.0.0.1:46070/solr/collection1/&wt=javabin&update.distrib=FROMLEADER&version=2} status=0 QTime=2 
[junit4:junit4]   2>  C56_STATE=coll:collection1 core:collection1 props:{roles=null, core=collection1, base_url=http://127.0.0.1:60354/solr, state=active, shard=shard1, node_name=127.0.0.1:60354_solr, collection=collection1}
[junit4:junit4]   2> 11488 T1046 C56 P60354 REQ /update {_version_=-1421149830371082240&update.from=http://127.0.0.1:45236/solr/collection1/&wt=javabin&update.distrib=FROMLEADER&version=2} status=0 QTime=2 
[junit4:junit4]   2> 11488 T1030 C59 P46070 REQ /update {wt=javabin&update.distrib=TOLEADER&version=2} status=0 QTime=7 
[junit4:junit4]   2> 11489 T1017 C57 P45236 /update {wt=javabin&version=2} {deleteByQuery=*:* (-1421149830371082240)} 0 10
[junit4:junit4]   2> 11494 T999 C60 P41009 /update {wt=javabin&version=2} {add=[1 (1421149830384713728)]} 0 3
[junit4:junit4]   2> 11501 T1047 C56 P60354 REQ /update {wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:45236/solr/collection1/} status=0 QTime=1 
[junit4:junit4]   2> 11502 T1015 C57 P45236 /update {wt=javabin&version=2} {add=[1 (1421149830388908032)]} 0 6
[junit4:junit4]   2> 11505 T1000 C60 P41009 /update {wt=javabin&version=2} {add=[2 (1421149830397296640)]} 0 1
[junit4:junit4]   2> 11516 T1062 C58 P37697 REQ /update {wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:46070/solr/collection1/} status=0 QTime=1 
[junit4:junit4]   2> 11517 T1031 C59 P46070 REQ /update {wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:45236/solr/collection1/} status=0 QTime=5 
[junit4:junit4]   2> 11517 T1016 C57 P45236 /update {wt=javabin&version=2} {add=[2]} 0 9
[junit4:junit4]   2> 11520 T998 C60 P41009 /update {wt=javabin&version=2} {add=[3 (1421149830413025280)]} 0 1
[junit4:junit4]   2> 11525 T1063 C58 P37697 REQ /update {wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:46070/solr/collection1/} status=0 QTime=1 
[junit4:junit4]   2> 11525 T1032 C59 P46070 /update {wt=javabin&version=2} {add=[3 (1421149830415122432)]} 0 4
[junit4:junit4]   2> 11528 T1001 C60 P41009 /update {wt=javabin&version=2} {add=[4 (1421149830421413888)]} 0 1
[junit4:junit4]   2> 11534 T1048 C56 P60354 REQ /update {wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:45236/solr/collection1/} status=0 QTime=0 
[junit4:junit4]   2> 11535 T1017 C57 P45236 REQ /update {wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:46070/solr/collection1/} status=0 QTime=4 
[junit4:junit4]   2> 11536 T1033 C59 P46070 /update {wt=javabin&version=2} {add=[4]} 0 6
[junit4:junit4]   2> 11539 T999 C60 P41009 /update {wt=javabin&version=2} {add=[5 (1421149830432948224)]} 0 1
[junit4:junit4]   2> 11544 T1065 C58 P37697 REQ /update {wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:46070/solr/collection1/} status=0 QTime=1 
[junit4:junit4]   2> 11545 T1030 C59 P46070 /update {wt=javabin&version=2} {add=[5 (1421149830436093952)]} 0 4
[junit4:junit4]   2> 11548 T1000 C60 P41009 /update {wt=javabin&version=2} {add=[6 (1421149830442385408)]} 0 1
[junit4:junit4]   2> 11554 T1064 C58 P37697 REQ /update {wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:46070/solr/collection1/} status=0 QTime=0 
[junit4:junit4]   2> 11555 T1031 C59 P46070 REQ /update {wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:45236/solr/collection1/} status=0 QTime=4 
[junit4:junit4]   2> 11555 T1015 C57 P45236 /update {wt=javabin&version=2} {add=[6]} 0 5
[junit4:junit4]   2> 11558 T998 C60 P41009 /update {wt=javabin&version=2} {add=[7 (1421149830453919744)]} 0 0
[junit4:junit4]   2> 11565 T1062 C58 P37697 REQ /update {wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:46070/solr/collection1/} status=0 QTime=1 
[junit4:junit4]   2> 11566 T1032 C59 P46070 REQ /update {wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:45236/solr/collection1/} status=0 QTime=4 
[junit4:junit4]   2> 11566 T1016 C57 P45236 /update {wt=javabin&version=2} {add=[7]} 0 5
[junit4:junit4]   2> 11569 T1001 C60 P41009 /update {wt=javabin&version=2} {add=[8 (1421149830465454080)]} 0 1
[junit4:junit4]   2> 11575 T1045 C56 P60354 REQ /update {wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:45236/solr/collection1/} status=0 QTime=1 
[junit4:junit4]   2> 11575 T1018 C57 P45236 /update {wt=javabin&version=2} {add=[8 (1421149830467551232)]} 0 4
[junit4:junit4]   2> 11578 T999 C60 P41009 /update {wt=javabin&version=2} {add=[9 (1421149830473842688)]} 0 1
[junit4:junit4]   2> 11584 T1063 C58 P37697 REQ /update {wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:46070/solr/collection1/} status=0 QTime=0 
[junit4:junit4]   2> 11585 T1033 C59 P46070 REQ /update {wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:45236/solr/collection1/} status=0 QTime=4 
[junit4:junit4]   2> 11585 T1017 C57 P45236 /update {wt=javabin&version=2} {add=[9]} 0 5
[junit4:junit4]   2> 11591 T1000 C60 P41009 /update {wt=javabin&version=2} {add=[10 (1421149830484328448)]} 0 4
[junit4:junit4]   2> 11598 T1046 C56 P60354 REQ /update {wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:45236/solr/collection1/} status=0 QTime=1 
[junit4:junit4]   2> 11599 T1015 C57 P45236 REQ /update {wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:46070/solr/collection1/} status=0 QTime=5 
[junit4:junit4]   2> 11599 T1030 C59 P46070 /update {wt=javabin&version=2} {add=[10]} 0 6
[junit4:junit4]   2> 11603 T998 C60 P41009 /update {wt=javabin&version=2} {add=[11 (1421149830499008512)]} 0 2
[junit4:junit4]   2> 11610 T1047 C56 P60354 REQ /update {wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:45236/solr/collection1/} status=0 QTime=1 
[junit4:junit4]   2> 11610 T1016 C57 P45236 REQ /update {wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:46070/solr/collection1/} status=0 QTime=4 
[junit4:junit4]   2> 11611 T1031 C59 P46070 /update {wt=javabin&version=2} {add=[11]} 0 6
[junit4:junit4]   2> 11614 T1001 C60 P41009 /update {wt=javabin&version=2} {add=[12 (1421149830511591424)]} 0 1
[junit4:junit4]   2> 11621 T1048 C56 P60354 REQ /update {wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:45236/solr/collection1/} status=0 QTime=1 
[junit4:junit4]   2> 11622 T1018 C57 P45236 REQ /update {wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:46070/solr/collection1/} status=0 QTime=5 
[junit4:junit4]   2> 11622 T1032 C59 P46070 /update {wt=javabin&version=2} {add=[12]} 0 6
[junit4:junit4]   2> 11625 T999 C60 P41009 /update {wt=javabin&version=2} {add=[13 (1421149830523125760)]} 0 1
[junit4:junit4]   2> 11631 T1045 C56 P60354 REQ /update {wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:45236/solr/collection1/} status=0 QTime=1 
[junit4:junit4]   2> 11632 T1017 C57 P45236 /update {wt=javabin&version=2} {add=[13 (1421149830526271488)]} 0 5
[junit4:junit4]   2> 11635 T1000 C60 P41009 /update {wt=javabin&version=2} {add=[14 (1421149830533611520)]} 0 1
[junit4:junit4]   2> 11641 T1046 C56 P60354 REQ /update {wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:45236/solr/collection1/} status=0 QTime=1 
[junit4:junit4]   2> 11642 T1015 C57 P45236 REQ /update {wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:46070/solr/collection1/} status=0 QTime=4 
[junit4:junit4]   2> 11642 T1033 C59 P46070 /update {wt=javabin&version=2} {add=[14]} 0 5
[junit4:junit4]   2> 11645 T998 C60 P41009 /update {wt=javabin&version=2} {add=[15 (1421149830545145856)]} 0 0
[junit4:junit4]   2> 11650 T1047 C56 P60354 REQ /update {wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:45236/solr/collection1/} status=0 QTime=1 
[junit4:junit4]   2> 11651 T1016 C57 P45236 /update {wt=javabin&version=2} {add=[15 (1421149830547243008)]} 0 4
[junit4:junit4]   2> 11653 T1001 C60 P41009 /update {wt=javabin&version=2} {add=[16 (1421149830553534464)]} 0 0
[junit4:junit4]   2> 11663 T1048 C56 P60354 REQ /update {wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:45236/solr/collection1/} status=0 QTime=3 
[junit4:junit4]   2> 11663 T1018 C57 P45236 /update {wt=javabin&version=2} {add=[16 (1421149830556680192)]} 0 7
[junit4:junit4]   2> 11669 T999 C60 P41009 /update {wt=javabin&version=2} {add=[17 (1421149830567165952)]} 0 3
[junit4:junit4]   2> 11677 T1065 C58 P37697 REQ /update {wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:46070/solr/collection1/} status=0 QTime=2 
[junit4:junit4]   2> 11678 T1030 C59 P46070 /update {wt=javabin&version=2} {add=[17 (1421149830573457408)]} 0 7
[junit4:junit4]   2> 11681 T1000 C60 P41009 /update {wt=javabin&version=2} {add=[100 (1421149830581846016)]} 0 1
[junit4:junit4]   2> 11687 T1045 C56 P60354 REQ /update {wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:45236/solr/collection1/} status=0 QTime=1 
[junit4:junit4]   2> 11687 T1017 C57 P45236 /update {wt=javabin&version=2} {add=[100 (1421149830584991744)]} 0 4
[junit4:junit4]   2> 11690 T998 C60 P41009 /update {wt=javabin&version=2} {add=[101 (1421149830592331776)]} 0 1
[junit4:junit4]   2> 11697 T1046 C56 P60354 REQ /update {wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:45236/solr/collection1/} status=0 QTime=1 
[junit4:junit4]   2> 11698 T1015 C57 P45236 REQ /update {wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:46070/solr/collection1/} status=0 QTime=4 
[junit4:junit4]   2> 11699 T1031 C59 P46070 /update {wt=javabin&version=2} {add=[101]} 0 7
[junit4:junit4]   2> 11703 T1001 C60 P41009 /update {wt=javabin&version=2} {add=[102 (1421149830603866112)]} 0 2
[junit4:junit4]   2> 11708 T1047 C56 P60354 REQ /update {wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:45236/solr/collection1/} status=0 QTime=0 
[junit4:junit4]   2> 11709 T1016 C57 P45236 /update {wt=javabin&version=2} {add=[102 (1421149830609108992)]} 0 3
[junit4:junit4]   2> 11713 T999 C60 P41009 /update {wt=javabin&version=2} {add=[103 (1421149830614351872)]} 0 2
[junit4:junit4]   2> 11718 T1064 C58 P37697 REQ /update {wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:46070/solr/collection1/} status=0 QTime=1 
[junit4:junit4]   2> 11719 T1033 C59 P46070 /update {wt=javabin&version=2} {add=[103 (1421149830618546176)]} 0 4
[junit4:junit4]   2> 11721 T1000 C60 P41009 /update {wt=javabin&version=2} {add=[104 (1421149830624837632)]} 0 0
[junit4:junit4]   2> 11726 T1062 C58 P37697 REQ /update {wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:46070/solr/collection1/} status=0 QTime=0 
[junit4:junit4]   2> 11727 T1030 C59 P46070 /update {wt=javabin&version=2} {add=[104 (1421149830626934784)]} 0 4
[junit4:junit4]   2> 11730 T998 C60 P41009 /update {wt=javabin&version=2} {add=[105 (1421149830633226240)]} 0 1
[junit4:junit4]   2> 11741 T1063 C58 P37697 REQ /update {wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:46070/solr/collection1/} status=0 QTime=3 
[junit4:junit4]   2> 11742 T1032 C59 P46070 REQ /update {wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:45236/solr/collection1/} status=0 QTime=9 
[junit4:junit4]   2> 11742 T1018 C57 P45236 /update {wt=javabin&version=2} {add=[105]} 0 10
[junit4:junit4]   2> 11746 T1001 C60 P41009 /update {wt=javabin&version=2} {add=[106 (1421149830650003456)]} 0 1
[junit4:junit4]   2> 11753 T1065 C58 P37697 REQ /update {wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:46070/solr/collection1/} status=0 QTime=2 
[junit4:junit4]   2> 11754 T1033 C59 P46070 /update {wt=javabin&version=2} {add=[106 (1421149830653149184)]} 0 6
[junit4:junit4]   2> 11757 T999 C60 P41009 /update {wt=javabin&version=2} {add=[107 (1421149830661537792)]} 0 1
[junit4:junit4]   2> 11764 T1048 C56 P60354 REQ /update {wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:45236/solr/collection1/} status=0 QTime=1 
[junit4:junit4]   2> 11764 T1017 C57 P45236 REQ /update {wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:46070/solr/collection1/} status=0 QTime=3 
[junit4:junit4]   2> 11765 T1030 C59 P46070 /update {wt=javabin&version=2} {add=[107]} 0 6
[junit4:junit4]   2> 11768 T1000 C60 P41009 /update {wt=javabin&version=2} {add=[108 (1421149830673072128)]} 0 1
[junit4:junit4]   2> 11775 T1045 C56 P60354 REQ /update {wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:45236/solr/collection1/} status=0 QTime=1 
[junit4:junit4]   2> 11775 T1015 C57 P45236 REQ /update {wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:46070/solr/collection1/} status=0 QTime=3 
[junit4:junit4]   2> 11776 T1031 C59 P46070 /update {wt=javabin&version=2} {add=[108]} 0 6
[junit4:junit4]   2> 11779 T998 C60 P41009 /update {wt=javabin&version=2} {add=[109 (1421149830684606464)]} 0 1
[junit4:junit4]   2> 11785 T1046 C56 P60354 REQ /update {wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:45236/solr/collection1/} status=0 QTime=1 
[junit4:junit4]   2> 11785 T1016 C57 P45236 /update {wt=javabin&version=2} {add=[109 (1421149830687752192)]} 0 4
[junit4:junit4]   2> 11789 T1001 C60 P41009 /update {wt=javabin&version=2} {add=[110 (1421149830695092224)]} 0 1
[junit4:junit4]   2> 11793 T1048 C56 P60354 REQ /update {wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:45236/solr/collection1/} status=0 QTime=0 
[junit4:junit4]   2> 11794 T1018 C57 P45236 /update {wt=javabin&version=2} {add=[110 (1421149830698237952)]} 0 3
[junit4:junit4]   2> 11797 T999 C60 P41009 /update {wt=javabin&version=2} {add=[111 (1421149830703480832)]} 0 1
[junit4:junit4]   2> 11804 T1045 C56 P60354 REQ /update {wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:45236/solr/collection1/} status=0 QTime=1 
[junit4:junit4]   2> 11804 T1017 C57 P45236 REQ /update {wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:46070/solr/collection1/} status=0 QTime=3 
[junit4:junit4]   2> 11805 T1032 C59 P46070 /update {wt=javabin&version=2} {add=[111]} 0 6
[junit4:junit4]   2> 11811 T1000 C60 P41009 /update {wt=javabin&version=2} {add=[112 (1421149830715015168)]} 0 4
[junit4:junit4]   2> 11818 T1064 C58 P37697 REQ /update {wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:46070/solr/collection1/} status=0 QTime=1 
[junit4:junit4]   2> 11818 T1033 C59 P46070 REQ /update {wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:45236/solr/collection1/} status=0 QTime=3 
[junit4:junit4]   2> 11819 T1015 C57 P45236 /update {wt=javabin&version=2} {add=[112]} 0 6
[junit4:junit4]   2> 11822 T998 C60 P41009 /update {wt=javabin&version=2} {add=[113 (1421149830729695232)]} 0 1
[junit4:junit4]   2> 11827 T1046 C56 P60354 REQ /update {wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:45236/solr/collection1/} status=0 QTime=0 
[junit4:junit4]   2> 11828 T1016 C57 P45236 /update {wt=javabin&version=2} {add=[113 (1421149830732840960)]} 0 4
[junit4:junit4]   2> 11831 T1001 C60 P41009 /update {wt=javabin&version=2} {add=[114 (1421149830739132416)]} 0 1
[junit4:junit4]   2> 11843 T1047 C56 P60354 REQ /update {wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:45236/solr/collection1/} status=0 QTime=4 
[junit4:junit4]   2> 11844 T1018 C57 P45236 REQ /update {wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:46070/solr/collection1/} status=0 QTime=9 
[junit4:junit4]   2> 11844 T1030 C59 P46070 /update {wt=javabin&version=2} {add=[114]} 0 11
[junit4:junit4]   2> 11848 T999 C60 P41009 /update {wt=javabin&version=2} {add=[115 (1421149830756958208)]} 0 1
[junit4:junit4]   2> 11855 T1062 C58 P37697 REQ /update {wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:46070/solr/collection1/} status=0 QTime=1 
[junit4:junit4]   2> 11855 T1031 C59 P46070 REQ /update {wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:45236/solr/collection1/} status=0 QTime=3 
[junit4:junit4]   2> 11856 T1017 C57 P45236 /update {wt=javabin&version=2} {add=[115]} 0 6
[junit4:junit4]   2> 11859 T1000 C60 P41009 /update {wt=javabin&version=2} {add=[116 (1421149830768492544)]} 0 1
[junit4:junit4]   2> 11866 T1065 C58 P37697 REQ /update {wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1

[...truncated too long message...]

lr/collections/collection1/leaders/shard2 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "core":"collection1",
[junit4:junit4]   1>            "node_name":"127.0.0.1:39435_solr",
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:39435/solr"}
[junit4:junit4]   1>      /solr/collections/collection1/leaders/shard1 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "core":"collection1",
[junit4:junit4]   1>            "node_name":"127.0.0.1:44685_solr",
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:44685/solr"}
[junit4:junit4]   1>   /solr/overseer (3)
[junit4:junit4]   1>   DATA:
[junit4:junit4]   1>       
[junit4:junit4]   1>    /solr/overseer/queue (0)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        
[junit4:junit4]   1>    /solr/overseer/collection-queue-work (0)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        
[junit4:junit4]   1>    /solr/overseer/queue-work (0)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        
[junit4:junit4]   1>  /zookeeper (1)
[junit4:junit4]   1>  DATA:
[junit4:junit4]   1>      
[junit4:junit4]   1> 
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=BasicDistributedZk2Test -Dtests.method=testDistribSearch -Dtests.seed=FC22DC14340EDE3F -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ar_DZ -Dtests.timezone=Pacific/Galapagos -Dtests.file.encoding=US-ASCII
[junit4:junit4] FAILURE  576s J1 | BasicDistributedZk2Test.testDistribSearch <<<
[junit4:junit4]    > Throwable #1: java.lang.AssertionError: There are still nodes recoverying - waited for 540 seconds
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([FC22DC14340EDE3F:7DC4520C4351BE03]:0)
[junit4:junit4]    > 	at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:165)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:115)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:110)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:563)
[junit4:junit4]    > 	at org.apache.solr.cloud.BasicDistributedZk2Test.brindDownShardIndexSomeDocsAndRecover(BasicDistributedZk2Test.java:321)
[junit4:junit4]    > 	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:83)
[junit4:junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:474)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 576063 T1147 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> NOTE: test params are: codec=Lucene3x, sim=DefaultSimilarity, locale=ar_DZ, timezone=Pacific/Galapagos
[junit4:junit4]   2> NOTE: Linux 3.2.0-34-generic i386/Oracle Corporation 1.8.0-ea (32-bit)/cpus=8,threads=2,free=25193656,total=248840192
[junit4:junit4]   2> NOTE: All tests run in this JVM: [TestCharFilters, FullSolrCloudDistribCmdsTest, SolrIndexConfigTest, TestTrie, TestDocSet, TestAtomicUpdateErrorCases, TestReversedWildcardFilterFactory, DisMaxRequestHandlerTest, UpdateParamsTest, DocumentAnalysisRequestHandlerTest, LeaderElectionTest, TestDistributedGrouping, TestBM25SimilarityFactory, TestFunctionQuery, URLClassifyProcessorTest, TestOmitPositions, TestStressRecovery, IndexSchemaRuntimeFieldTest, StatsComponentTest, SignatureUpdateProcessorFactoryTest, TestValueSourceCache, RecoveryZkTest, TestQueryUtils, TestSolrJ, SyncSliceTest, CoreContainerCoreInitFailuresTest, PingRequestHandlerTest, TestPluginEnable, TestSolrXMLSerializer, LukeRequestHandlerTest, TestReload, TestQuerySenderListener, TestZkChroot, TestFoldingMultitermQuery, XsltUpdateRequestHandlerTest, UUIDFieldTest, StandardRequestHandlerTest, SolrInfoMBeanTest, TestStressReorder, BasicDistributedZk2Test]
[junit4:junit4] Completed on J1 in 576.09s, 1 test, 1 failure <<< FAILURES!

[...truncated 59 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:352: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:178: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:438: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1171: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:835: There were test failures: 239 suites, 994 tests, 1 error, 1 failure, 7 ignored (2 assumptions)

Total time: 33 minutes 24 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 32bit/jdk1.8.0-ea-b65 -client -XX:+UseParallelGC
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-4.x-Linux (32bit/jdk1.6.0_37) - Build # 3181 - Still Failing!

Posted by Policeman Jenkins Server <je...@sd-datasolutions.de>.
Build: http://jenkins.sd-datasolutions.de/job/Lucene-Solr-4.x-Linux/3181/
Java: 32bit/jdk1.6.0_37 -server -XX:+UseSerialGC

2 tests failed.
FAILED:  org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch

Error Message:
There are still nodes recoverying - waited for 540 seconds

Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 540 seconds
	at __randomizedtesting.SeedInfo.seed([198081057303A3DE:98660F1D045CC3E2]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:165)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:115)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:110)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:563)
	at org.apache.solr.cloud.BasicDistributedZk2Test.brindDownShardIndexSomeDocsAndRecover(BasicDistributedZk2Test.java:321)
	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:83)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:662)


FAILED:  org.apache.solr.cloud.BasicDistributedZkTest.testDistribSearch

Error Message:
Server at http://127.0.0.1:44533/solr returned non ok status:500, message:Server Error

Stack Trace:
org.apache.solr.common.SolrException: Server at http://127.0.0.1:44533/solr returned non ok status:500, message:Server Error
	at __randomizedtesting.SeedInfo.seed([198081057303A3DE:98660F1D045CC3E2]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:372)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
	at org.apache.solr.client.solrj.request.CoreAdminRequest.process(CoreAdminRequest.java:429)
	at org.apache.solr.client.solrj.request.CoreAdminRequest.getStatus(CoreAdminRequest.java:472)
	at org.apache.solr.cloud.BasicDistributedZkTest.collectStartTimes(BasicDistributedZkTest.java:959)
	at org.apache.solr.cloud.BasicDistributedZkTest.testCollectionsAPI(BasicDistributedZkTest.java:795)
	at org.apache.solr.cloud.BasicDistributedZkTest.doTest(BasicDistributedZkTest.java:343)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:662)




Build Log:
[...truncated 8168 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZkTest
[junit4:junit4]   2> 3 T1366 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZkTest-1355310262799
[junit4:junit4]   2> 3 T1366 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 4 T1367 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 4 T1367 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 4 T1367 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4]   2> 4 T1367 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4]   2> 5 T1367 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 5 T1367 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1355310262799/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4]   2> 104 T1366 oasc.ZkTestServer.run start zk server on port:55662
[junit4:junit4]   2> 104 T1366 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:55662 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@108050f
[junit4:junit4]   2> 106 T1372 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:55662. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 106 T1366 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 107 T1372 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:55662, initiating session
[junit4:junit4]   2> 107 T1368 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:57803
[junit4:junit4]   2> 107 T1368 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:57803
[junit4:junit4]   2> 108 T1370 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 240 T1370 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8ec96a120000 with negotiated timeout 10000 for client /127.0.0.1:57803
[junit4:junit4]   2> 240 T1372 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:55662, sessionid = 0x13b8ec96a120000, negotiated timeout = 10000
[junit4:junit4]   2> 240 T1373 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@108050f name:ZooKeeperConnection Watcher:127.0.0.1:55662 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 241 T1366 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 241 T1366 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 247 T1371 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8ec96a120000
[junit4:junit4]   2> 247 T1373 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 248 T1368 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:57803 which had sessionid 0x13b8ec96a120000
[junit4:junit4]   2> 247 T1366 oaz.ZooKeeper.close Session: 0x13b8ec96a120000 closed
[junit4:junit4]   2> 249 T1366 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:55662/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1c371c6
[junit4:junit4]   2> 250 T1374 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:55662. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 250 T1366 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 251 T1374 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:55662, initiating session
[junit4:junit4]   2> 251 T1368 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:57804
[junit4:junit4]   2> 252 T1368 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:57804
[junit4:junit4]   2> 253 T1370 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8ec96a120001 with negotiated timeout 10000 for client /127.0.0.1:57804
[junit4:junit4]   2> 253 T1374 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:55662, sessionid = 0x13b8ec96a120001, negotiated timeout = 10000
[junit4:junit4]   2> 253 T1375 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c371c6 name:ZooKeeperConnection Watcher:127.0.0.1:55662/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 253 T1366 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 254 T1366 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 259 T1366 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 262 T1366 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 265 T1366 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 269 T1366 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 270 T1366 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 276 T1366 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 277 T1366 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 282 T1366 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 283 T1366 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 287 T1366 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 288 T1366 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 292 T1366 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 293 T1366 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 297 T1366 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 298 T1366 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 302 T1366 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 303 T1366 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 307 T1366 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 308 T1366 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 313 T1366 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 314 T1366 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 317 T1366 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 318 T1366 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 322 T1371 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8ec96a120001
[junit4:junit4]   2> 323 T1375 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 323 T1368 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:57804 which had sessionid 0x13b8ec96a120001
[junit4:junit4]   2> 323 T1366 oaz.ZooKeeper.close Session: 0x13b8ec96a120001 closed
[junit4:junit4]   2> 402 T1366 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 404 T1366 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:49005
[junit4:junit4]   2> 404 T1366 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 405 T1366 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355310263120
[junit4:junit4]   2> 405 T1366 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355310263120/'
[junit4:junit4]   2> 417 T1366 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 417 T1366 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 418 T1366 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355310263120
[junit4:junit4]   2> 418 T1366 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355310263120/solr.xml
[junit4:junit4]   2> 418 T1366 oasc.CoreContainer.<init> New CoreContainer 29333395
[junit4:junit4]   2> 419 T1366 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355310263120/'
[junit4:junit4]   2> 419 T1366 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355310263120/'
[junit4:junit4]   2> 431 T1366 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 441 T1366 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:55662/solr
[junit4:junit4]   2> 441 T1366 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 442 T1366 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:55662 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@563d7a
[junit4:junit4]   2> 442 T1366 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 442 T1385 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:55662. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 443 T1385 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:55662, initiating session
[junit4:junit4]   2> 443 T1368 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:57809
[junit4:junit4]   2> 443 T1368 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:57809
[junit4:junit4]   2> 444 T1370 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8ec96a120002 with negotiated timeout 20000 for client /127.0.0.1:57809
[junit4:junit4]   2> 444 T1385 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:55662, sessionid = 0x13b8ec96a120002, negotiated timeout = 20000
[junit4:junit4]   2> 444 T1386 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@563d7a name:ZooKeeperConnection Watcher:127.0.0.1:55662 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 444 T1366 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 445 T1371 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8ec96a120002
[junit4:junit4]   2> 446 T1368 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:57809 which had sessionid 0x13b8ec96a120002
[junit4:junit4]   2> 446 T1386 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 446 T1366 oaz.ZooKeeper.close Session: 0x13b8ec96a120002 closed
[junit4:junit4]   2> 447 T1366 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:55662/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@dafa1b
[junit4:junit4]   2> 447 T1387 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:55662. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 447 T1366 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 448 T1387 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:55662, initiating session
[junit4:junit4]   2> 448 T1368 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:57810
[junit4:junit4]   2> 448 T1368 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:57810
[junit4:junit4]   2> 448 T1370 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8ec96a120003 with negotiated timeout 8000 for client /127.0.0.1:57810
[junit4:junit4]   2> 448 T1387 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:55662, sessionid = 0x13b8ec96a120003, negotiated timeout = 8000
[junit4:junit4]   2> 449 T1388 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@dafa1b name:ZooKeeperConnection Watcher:127.0.0.1:55662/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 449 T1366 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 450 T1371 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ec96a120003 type:create cxid:0x2 zxid:0x1b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 451 T1366 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 452 T1366 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49005_solr
[junit4:junit4]   2> 453 T1371 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ec96a120003 type:delete cxid:0x7 zxid:0x1d txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:49005_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:49005_solr
[junit4:junit4]   2> 453 T1366 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49005_solr
[junit4:junit4]   2> 456 T1366 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 456 T1366 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 457 T1366 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 457 T1366 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 457 T1366 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 458 T1366 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 458 T1366 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 459 T1366 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 459 T1366 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 460 T1366 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 464 T1366 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 470 T1371 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ec96a120003 type:delete cxid:0x15 zxid:0x22 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 471 T1366 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 474 T1366 oasc.Overseer.start Overseer (id=88821613382991875-127.0.0.1:49005_solr-n_0000000000) starting
[junit4:junit4]   2> 476 T1371 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ec96a120003 type:create cxid:0x1a zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 477 T1371 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ec96a120003 type:create cxid:0x1b zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 478 T1371 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ec96a120003 type:create cxid:0x1c zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 479 T1371 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ec96a120003 type:create cxid:0x1d zxid:0x27 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 480 T1390 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
[junit4:junit4]   2> 482 T1366 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 485 T1366 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 488 T1389 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 496 T1391 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355310263120/collection1
[junit4:junit4]   2> 496 T1391 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4]   2> 497 T1391 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 497 T1391 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4]   2> 499 T1391 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355310263120/collection1/'
[junit4:junit4]   2> 500 T1391 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355310263120/collection1/lib/README' to classloader
[junit4:junit4]   2> 500 T1391 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355310263120/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 573 T1391 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 618 T1391 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 619 T1391 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 623 T1391 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 1028 T1391 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 1045 T1391 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 1048 T1391 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 1064 T1391 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1068 T1391 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1071 T1391 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1073 T1391 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1074 T1391 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355310263120/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355310262799/control/data/
[junit4:junit4]   2> 1075 T1391 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@15ed659
[junit4:junit4]   2> 1076 T1391 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355310262799/control/data/index/
[junit4:junit4]   2> 1076 T1391 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355310262799/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 1077 T1391 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1355310262799/control/data/index forceNew:false
[junit4:junit4]   2> 1082 T1391 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1355310262799/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1bd751f; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 1082 T1391 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 1083 T1391 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 1085 T1391 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 1085 T1391 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 1086 T1391 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 1086 T1391 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 1087 T1391 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 1087 T1391 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 1088 T1391 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 1089 T1391 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 1090 T1391 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 1091 T1391 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 1091 T1391 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 1092 T1391 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 1092 T1391 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 1092 T1391 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 1092 T1391 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 1093 T1391 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 1094 T1391 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1094 T1391 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1095 T1391 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1096 T1391 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1096 T1391 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1097 T1391 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1097 T1391 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1098 T1391 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 1099 T1391 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 1100 T1391 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 1102 T1391 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 1103 T1391 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 1105 T1391 oass.SolrIndexSearcher.<init> Opening Searcher@6158 main
[junit4:junit4]   2> 1105 T1391 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 1105 T1391 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 1106 T1391 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 1106 T1391 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 1109 T1391 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 1142 T1392 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6158 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 1147 T1391 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 1147 T1391 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 1148 T1371 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ec96a120003 type:create cxid:0x53 zxid:0x2a txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 1150 T1391 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 1150 T1391 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:49005/solr shardId:control_shard
[junit4:junit4]   2> 1151 T1391 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/control_shard/election
[junit4:junit4]   2> 1163 T1371 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ec96a120003 type:delete cxid:0x62 zxid:0x31 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4]   2> 1163 T1391 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 1164 T1371 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ec96a120003 type:create cxid:0x63 zxid:0x32 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1494 T1389 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 1495 T1389 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":"control_shard",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:49005_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:49005/solr"}
[junit4:junit4]   2> 1496 T1371 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ec96a120003 type:create cxid:0x6a zxid:0x34 txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 1507 T1388 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 1667 T1391 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 1667 T1391 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 1668 T1391 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:49005/solr/collection1/
[junit4:junit4]   2> 1668 T1391 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 1668 T1391 oasc.SyncStrategy.syncToMe http://127.0.0.1:49005/solr/collection1/ has no replicas
[junit4:junit4]   2> 1669 T1391 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:49005/solr/collection1/
[junit4:junit4]   2> 1669 T1391 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/control_shard
[junit4:junit4]   2> 1676 T1371 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ec96a120003 type:create cxid:0x89 zxid:0x3f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2014 T1389 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2020 T1388 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 2030 T1391 oasc.ZkController.register We are http://127.0.0.1:49005/solr/collection1/ and leader is http://127.0.0.1:49005/solr/collection1/
[junit4:junit4]   2> 2030 T1391 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:49005/solr
[junit4:junit4]   2> 2030 T1391 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 2031 T1391 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 2031 T1391 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 2033 T1391 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2034 T1366 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   2> 2035 T1366 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 2036 T1366 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 2101 T1366 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 2102 T1366 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:44533
[junit4:junit4]   2> 2103 T1366 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 2103 T1366 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty1-1355310264839
[junit4:junit4]   2> 2103 T1366 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty1-1355310264839/'
[junit4:junit4]   2> 2118 T1366 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 2119 T1366 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 2119 T1366 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty1-1355310264839
[junit4:junit4]   2> 2119 T1366 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty1-1355310264839/solr.xml
[junit4:junit4]   2> 2120 T1366 oasc.CoreContainer.<init> New CoreContainer 4595499
[junit4:junit4]   2> 2120 T1366 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty1-1355310264839/'
[junit4:junit4]   2> 2120 T1366 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty1-1355310264839/'
[junit4:junit4]   2> 2133 T1366 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 2143 T1366 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:55662/solr
[junit4:junit4]   2> 2144 T1366 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 2144 T1366 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:55662 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1ca8f50
[junit4:junit4]   2> 2145 T1366 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2145 T1402 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:55662. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 2145 T1402 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:55662, initiating session
[junit4:junit4]   2> 2146 T1368 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:57822
[junit4:junit4]   2> 2146 T1368 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:57822
[junit4:junit4]   2> 2147 T1370 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8ec96a120004 with negotiated timeout 20000 for client /127.0.0.1:57822
[junit4:junit4]   2> 2147 T1402 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:55662, sessionid = 0x13b8ec96a120004, negotiated timeout = 20000
[junit4:junit4]   2> 2148 T1403 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ca8f50 name:ZooKeeperConnection Watcher:127.0.0.1:55662 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2148 T1366 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2149 T1371 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8ec96a120004
[junit4:junit4]   2> 2150 T1403 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 2150 T1368 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:57822 which had sessionid 0x13b8ec96a120004
[junit4:junit4]   2> 2150 T1366 oaz.ZooKeeper.close Session: 0x13b8ec96a120004 closed
[junit4:junit4]   2> 2151 T1366 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:55662/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@1f65769
[junit4:junit4]   2> 2151 T1404 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:55662. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 2151 T1366 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2152 T1404 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:55662, initiating session
[junit4:junit4]   2> 2152 T1368 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:57823
[junit4:junit4]   2> 2152 T1368 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:57823
[junit4:junit4]   2> 2153 T1370 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8ec96a120005 with negotiated timeout 8000 for client /127.0.0.1:57823
[junit4:junit4]   2> 2153 T1404 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:55662, sessionid = 0x13b8ec96a120005, negotiated timeout = 8000
[junit4:junit4]   2> 2153 T1405 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f65769 name:ZooKeeperConnection Watcher:127.0.0.1:55662/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2153 T1366 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2154 T1371 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ec96a120005 type:create cxid:0x1 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2154 T1371 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ec96a120005 type:create cxid:0x2 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2155 T1366 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44533_solr
[junit4:junit4]   2> 2156 T1371 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ec96a120005 type:delete cxid:0x4 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:44533_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:44533_solr
[junit4:junit4]   2> 2156 T1366 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:44533_solr
[junit4:junit4]   2> 2157 T1388 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 2158 T1366 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 2159 T1388 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 2158 T1366 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 2159 T1366 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 2159 T1366 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 2159 T1366 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 2160 T1366 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 2160 T1366 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 2160 T1366 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 2161 T1366 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 2161 T1366 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 2165 T1366 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 2170 T1406 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty1-1355310264839/collection1
[junit4:junit4]   2> 2171 T1406 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 2171 T1406 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 2171 T1406 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 2172 T1406 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty1-1355310264839/collection1/'
[junit4:junit4]   2> 2172 T1406 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/solrtest-jetty1-1355310264839/collection1/lib/README' to classloader
[junit4:junit4]   2> 2173 T1406 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/solrtest-jetty1-1355310264839/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 2212 T1406 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 2255 T1406 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 2256 T1406 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 2259 T1406 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 2524 T1389 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2524 T1389 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":"control_shard",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:49005_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:49005/solr"}
[junit4:junit4]   2> 2527 T1388 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 2527 T1405 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 2656 T1406 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 2662 T1406 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 2664 T1406 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 2675 T1406 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 2686 T1406 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 2690 T1406 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 2692 T1406 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 2694 T1406 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty1-1355310264839/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355310262799/jetty1/
[junit4:junit4]   2> 2694 T1406 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@15ed659
[junit4:junit4]   2> 2695 T1406 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355310262799/jetty1/index/
[junit4:junit4]   2> 2696 T1406 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355310262799/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 2696 T1406 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1355310262799/jetty1/index forceNew:false
[junit4:junit4]   2> 2702 T1406 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1355310262799/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@668c55; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 2702 T1406 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 2703 T1406 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 2705 T1406 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 2706 T1406 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 2706 T1406 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 2707 T1406 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 2707 T1406 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 2708 T1406 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 2708 T1406 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 2710 T1406 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 2711 T1406 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 2711 T1406 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 2712 T1406 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 2712 T1406 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 2713 T1406 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 2713 T1406 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 2713 T1406 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 2714 T1406 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 2715 T1406 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2715 T1406 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2716 T1406 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2717 T1406 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2717 T1406 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2718 T1406 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2719 T1406 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2719 T1406 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 2720 T1406 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 2722 T1406 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 2725 T1406 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 2726 T1406 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 2728 T1406 oass.SolrIndexSearcher.<init> Opening Searcher@166b0f5 main
[junit4:junit4]   2> 2728 T1406 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 2729 T1406 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 2729 T1406 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 2730 T1406 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 2733 T1406 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 2760 T1407 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@166b0f5 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 2767 T1406 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 2767 T1406 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 3032 T1389 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3033 T1389 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:44533_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:44533/solr"}
[junit4:junit4]   2> 3034 T1389 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4]   2> 3034 T1389 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 3040 T1388 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3040 T1405 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3268 T1406 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 3268 T1406 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:44533/solr shardId:shard1
[junit4:junit4]   2> 3270 T1406 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 3279 T1371 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ec96a120005 type:delete cxid:0x45 zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 3279 T1406 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 3280 T1371 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ec96a120005 type:create cxid:0x46 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3282 T1406 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 3283 T1406 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 3283 T1406 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:44533/solr/collection1/
[junit4:junit4]   2> 3283 T1406 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 3284 T1406 oasc.SyncStrategy.syncToMe http://127.0.0.1:44533/solr/collection1/ has no replicas
[junit4:junit4]   2> 3284 T1406 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:44533/solr/collection1/
[junit4:junit4]   2> 3284 T1406 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 3290 T1371 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ec96a120005 type:create cxid:0x50 zxid:0x60 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3545 T1389 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3556 T1388 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3556 T1405 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3593 T1406 oasc.ZkController.register We are http://127.0.0.1:44533/solr/collection1/ and leader is http://127.0.0.1:44533/solr/collection1/
[junit4:junit4]   2> 3593 T1406 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:44533/solr
[junit4:junit4]   2> 3593 T1406 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 3594 T1406 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 3594 T1406 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 3596 T1406 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3597 T1366 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   2> 3598 T1366 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 3599 T1366 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 3659 T1366 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 3660 T1366 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:53458
[junit4:junit4]   2> 3661 T1366 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 3661 T1366 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty2-1355310266401
[junit4:junit4]   2> 3661 T1366 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty2-1355310266401/'
[junit4:junit4]   2> 3673 T1366 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 3674 T1366 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 3674 T1366 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty2-1355310266401
[junit4:junit4]   2> 3675 T1366 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty2-1355310266401/solr.xml
[junit4:junit4]   2> 3675 T1366 oasc.CoreContainer.<init> New CoreContainer 14942221
[junit4:junit4]   2> 3675 T1366 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty2-1355310266401/'
[junit4:junit4]   2> 3676 T1366 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty2-1355310266401/'
[junit4:junit4]   2> 3688 T1366 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 3697 T1366 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:55662/solr
[junit4:junit4]   2> 3697 T1366 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 3698 T1366 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:55662 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@8f6f1f
[junit4:junit4]   2> 3698 T1366 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3698 T1417 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:55662. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 3699 T1417 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:55662, initiating session
[junit4:junit4]   2> 3699 T1368 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:57824
[junit4:junit4]   2> 3699 T1368 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:57824
[junit4:junit4]   2> 3700 T1370 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8ec96a120006 with negotiated timeout 20000 for client /127.0.0.1:57824
[junit4:junit4]   2> 3700 T1417 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:55662, sessionid = 0x13b8ec96a120006, negotiated timeout = 20000
[junit4:junit4]   2> 3700 T1418 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@8f6f1f name:ZooKeeperConnection Watcher:127.0.0.1:55662 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3700 T1366 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3701 T1371 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8ec96a120006
[junit4:junit4]   2> 3702 T1418 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 3702 T1368 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:57824 which had sessionid 0x13b8ec96a120006
[junit4:junit4]   2> 3702 T1366 oaz.ZooKeeper.close Session: 0x13b8ec96a120006 closed
[junit4:junit4]   2> 3703 T1366 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:55662/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@30f2ce
[junit4:junit4]   2> 3703 T1419 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:55662. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 3703 T1366 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3704 T1419 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:55662, initiating session
[junit4:junit4]   2> 3704 T1368 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:57825
[junit4:junit4]   2> 3704 T1368 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:57825
[junit4:junit4]   2> 3704 T1370 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8ec96a120007 with negotiated timeout 8000 for client /127.0.0.1:57825
[junit4:junit4]   2> 3704 T1419 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:55662, sessionid = 0x13b8ec96a120007, negotiated timeout = 8000
[junit4:junit4]   2> 3705 T1420 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@30f2ce name:ZooKeeperConnection Watcher:127.0.0.1:55662/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3705 T1366 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3706 T1371 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ec96a120007 type:create cxid:0x1 zxid:0x6d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3706 T1371 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ec96a120007 type:create cxid:0x2 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3707 T1366 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53458_solr
[junit4:junit4]   2> 3707 T1371 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ec96a120007 type:delete cxid:0x4 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:53458_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:53458_solr
[junit4:junit4]   2> 3708 T1366 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53458_solr
[junit4:junit4]   2> 3709 T1405 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3709 T1388 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3710 T1366 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 3710 T1405 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 3710 T1388 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 3710 T1366 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 3711 T1366 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 3711 T1366 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 3711 T1366 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 3712 T1366 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 3712 T1366 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 3712 T1366 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 3713 T1366 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 3713 T1366 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 3717 T1366 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3722 T1421 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty2-1355310266401/collection1
[junit4:junit4]   2> 3722 T1421 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 3723 T1421 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 3723 T1421 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 3724 T1421 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty2-1355310266401/collection1/'
[junit4:junit4]   2> 3724 T1421 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/solrtest-jetty2-1355310266401/collection1/lib/README' to classloader
[junit4:junit4]   2> 3725 T1421 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/solrtest-jetty2-1355310266401/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 3772 T1421 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 3823 T1421 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 3824 T1421 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 3827 T1421 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 4067 T1389 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4067 T1389 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:44533_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:44533/solr"}
[junit4:junit4]   2> 4071 T1388 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4071 T1420 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4071 T1405 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4247 T1421 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 4252 T1421 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 4255 T1421 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 4268 T1421 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 4274 T1421 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 4280 T1421 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 4281 T1421 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 4283 T1421 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty2-1355310266401/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355310262799/jetty2/
[junit4:junit4]   2> 4284 T1421 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@15ed659
[junit4:junit4]   2> 4285 T1421 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355310262799/jetty2/index/
[junit4:junit4]   2> 4285 T1421 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355310262799/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 4286 T1421 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1355310262799/jetty2/index forceNew:false
[junit4:junit4]   2> 4291 T1421 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1355310262799/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1253766; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 4292 T1421 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 4293 T1421 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 4295 T1421 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 4296 T1421 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 4296 T1421 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 4297 T1421 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 4297 T1421 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 4298 T1421 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 4298 T1421 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 4300 T1421 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 4301 T1421 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 4303 T1421 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 4304 T1421 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 4305 T1421 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 4306 T1421 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 4306 T1421 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 4307 T1421 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 4308 T1421 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 4310 T1421 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4311 T1421 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4311 T1421 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4312 T1421 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4313 T1421 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4313 T1421 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4314 T1421 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4315 T1421 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 4315 T1421 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 4317 T1421 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 4331 T1421 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 4334 T1421 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 4337 T1421 oass.SolrIndexSearcher.<init> Opening Searcher@1d45f47 main
[junit4:junit4]   2> 4338 T1421 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 4339 T1421 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 4339 T1421 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 4339 T1421 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 4343 T1421 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 4374 T1422 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1d45f47 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 4382 T1421 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 4383 T1421 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 4576 T1389 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4577 T1389 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:53458_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:53458/solr"}
[junit4:junit4]   2> 4577 T1389 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 4578 T1389 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4]   2> 4584 T1420 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4584 T1405 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4584 T1388 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4884 T1421 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 4885 T1421 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:53458/solr shardId:shard2
[junit4:junit4]   2> 4885 T1421 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4]   2> 4894 T1371 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ec96a120007 type:delete cxid:0x44 zxid:0x7e txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard2 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard2
[junit4:junit4]   2> 4895 T1421 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 4895 T1371 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ec96a120007 type:create cxid:0x45 zxid:0x7f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4898 T1421 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 4898 T1421 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 4899 T1421 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:53458/solr/collection1/
[junit4:junit4]   2> 4899 T1421 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 4899 T1421 oasc.SyncStrategy.syncToMe http://127.0.0.1:53458/solr/collection1/ has no replicas
[junit4:junit4]   2> 4899 T1421 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:53458/solr/collection1/
[junit4:junit4]   2> 4900 T1421 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4]   2> 4903 T1371 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ec96a120007 type:create cxid:0x4e zxid:0x82 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5089 T1389 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5098 T1388 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5098 T1405 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5098 T1420 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5105 T1421 oasc.ZkController.register We are http://127.0.0.1:53458/solr/collection1/ and leader is http://127.0.0.1:53458/solr/collection1/
[junit4:junit4]   2> 5106 T1421 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:53458/solr
[junit4:junit4]   2> 5106 T1421 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 5107 T1421 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 5107 T1421 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 5109 T1421 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5110 T1366 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   2> 5111 T1366 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 5112 T1366 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 5173 T1366 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 5174 T1366 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:50889
[junit4:junit4]   2> 5175 T1366 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 5175 T1366 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty3-1355310267913
[junit4:junit4]   2> 5176 T1366 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty3-1355310267913/'
[junit4:junit4]   2> 5187 T1366 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 5187 T1366 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 5188 T1366 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty3-1355310267913
[junit4:junit4]   2> 5188 T1366 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty3-1355310267913/solr.xml
[junit4:junit4]   2> 5188 T1366 oasc.CoreContainer.<init> New CoreContainer 29401117
[junit4:junit4]   2> 5189 T1366 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty3-1355310267913/'
[junit4:junit4]   2> 5189 T1366 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty3-1355310267913/'
[junit4:junit4]   2> 5201 T1366 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 5210 T1366 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:55662/solr
[junit4:junit4]   2> 5211 T1366 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 5211 T1366 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:55662 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@7409f4
[junit4:junit4]   2> 5212 T1366 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 5212 T1432 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:55662. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 5212 T1432 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:55662, initiating session
[junit4:junit4]   2> 5212 T1368 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:57827
[junit4:junit4]   2> 5213 T1368 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:57827
[junit4:junit4]   2> 5213 T1370 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8ec96a120008 with negotiated timeout 20000 for client /127.0.0.1:57827
[junit4:junit4]   2> 5213 T1432 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:55662, sessionid = 0x13b8ec96a120008, negotiated timeout = 20000
[junit4:junit4]   2> 5214 T1433 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7409f4 name:ZooKeeperConnection Watcher:127.0.0.1:55662 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 5214 T1366 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 5215 T1371 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8ec96a120008
[junit4:junit4]   2> 5216 T1368 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:57827 which had sessionid 0x13b8ec96a120008
[junit4:junit4]   2> 5216 T1433 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 5216 T1366 oaz.ZooKeeper.close Session: 0x13b8ec96a120008 closed
[junit4:junit4]   2> 5216 T1366 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:55662/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@1414b57
[junit4:junit4]   2> 5217 T1434 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:55662. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 5217 T1366 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 5218 T1368 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:57828
[junit4:junit4]   2> 5218 T1434 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:55662, initiating session
[junit4:junit4]   2> 5218 T1368 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:57828
[junit4:junit4]   2> 5219 T1370 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8ec96a120009 with negotiated timeout 8000 for client /127.0.0.1:57828
[junit4:junit4]   2> 5219 T1434 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:55662, sessionid = 0x13b8ec96a120009, negotiated timeout = 8000
[junit4:junit4]   2> 5219 T1435 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1414b57 name:ZooKeeperConnection Watcher:127.0.0.1:55662/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 5219 T1366 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 5220 T1371 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ec96a120009 type:create cxid:0x1 zxid:0x8f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5221 T1371 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ec96a120009 type:create cxid:0x2 zxid:0x90 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5221 T1366 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50889_solr
[junit4:junit4]   2> 5222 T1371 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ec96a120009 type:delete cxid:0x4 zxid:0x91 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:50889_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:50889_solr
[junit4:junit4]   2> 5222 T1366 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50889_solr
[junit4:junit4]   2> 5224 T1388 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5224 T1420 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5224 T1405 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5225 T1366 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 5225 T1388 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 5225 T1420 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 5225 T1366 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 5225 T1405 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 5226 T1366 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 5226 T1366 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 5226 T1366 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 5227 T1366 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 5227 T1366 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 5227 T1366 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 5228 T1366 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 5228 T1366 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 5232 T1366 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 5238 T1436 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty3-1355310267913/collection1
[junit4:junit4]   2> 5238 T1436 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 5239 T1436 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 5239 T1436 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 5240 T1436 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty3-1355310267913/collection1/'
[junit4:junit4]   2> 5240 T1436 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/solrtest-jetty3-1355310267913/collection1/lib/README' to classloader
[junit4:junit4]   2> 5240 T1436 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/solrtest-jetty3-1355310267913/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 5270 T1436 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 5326 T1436 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 5327 T1436 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 5331 T1436 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 5607 T1389 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5608 T1389 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:53458_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:53458/solr"}
[junit4:junit4]   2> 5612 T1405 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5612 T1388 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5612 T1435 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5612 T1420 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5761 T1436 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 5766 T1436 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 5769 T1436 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 5781 T1436 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5784 T1436 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5787 T1436 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5788 T1436 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5789 T1436 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty3-1355310267913/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355310262799/jetty3/
[junit4:junit4]   2> 5789 T1436 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@15ed659
[junit4:junit4]   2> 5790 T1436 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355310262799/jetty3/index/
[junit4:junit4]   2> 5790 T1436 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355310262799/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 5790 T1436 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1355310262799/jetty3/index forceNew:false
[junit4:junit4]   2> 5794 T1436 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1355310262799/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@122c4ef; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 5795 T1436 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 5795 T1436 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 5797 T1436 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 5797 T1436 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 5798 T1436 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 5798 T1436 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 5799 T1436 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 5799 T1436 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 5799 T1436 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 5800 T1436 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 5801 T1436 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 5802 T1436 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 5803 T1436 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 5804 T1436 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 5805 T1436 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 5805 T1436 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 5805 T1436 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 5806 T1436 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 5807 T1436 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5808 T1436 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5809 T1436 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5810 T1436 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5811 T1436 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5812 T1436 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5813 T1436 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5814 T1436 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 5816 T1436 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 5818 T1436 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 5821 T1436 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 5822 T1436 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 5825 T1436 oass.SolrIndexSearcher.<init> Opening Searcher@40f2f2 main
[junit4:junit4]   2> 5825 T1436 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 5826 T1436 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 5826 T1436 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 5827 T1436 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 5831 T1436 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 5883 T1437 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@40f2f2 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 5892 T1436 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 5892 T1436 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 6115 T1389 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6115 T1389 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:50889_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:50889/solr"}
[junit4:junit4]   2> 6116 T1389 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 6116 T1389 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 6119 T1420 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6119 T1405 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6119 T1435 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6119 T1388 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6394 T1436 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 6394 T1436 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:50889/solr shardId:shard1
[junit4:junit4]   2> 6397 T1436 oasc.ZkController.register We are http://127.0.0.1:50889/solr/collection1/ and leader is http://127.0.0.1:44533/solr/collection1/
[junit4:junit4]   2> 6397 T1436 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:50889/solr
[junit4:junit4]   2> 6397 T1436 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 6398 T1436 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C99 name=collection1 org.apache.solr.core.SolrCore@1c2d517 url=http://127.0.0.1:50889/solr/collection1 node=127.0.0.1:50889_solr
[junit4:junit4]   2> 6398 T1438 C99 P50889 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 6398 T1438 C99 P50889 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 6398 T1436 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6399 T1438 C99 P50889 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 6399 T1438 C99 P50889 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 6399 T1366 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   2> 6399 T1438 C99 P50889 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:44533/solr/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 6400 T1438 C99 P50889 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:50889/solr START replicas=[http://127.0.0.1:44533/solr/collection1/] nUpdates=100
[junit4:junit4]   2> 6400 T1366 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 6400 T1438 C99 P50889 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 6400 T1438 C99 P50889 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 6400 T1366 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 6400 T1438 C99 P50889 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 6401 T1438 C99 P50889 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C100 name=collection1 org.apache.solr.core.SolrCore@2d167e url=http://127.0.0.1:44533/solr/collection1 node=127.0.0.1:44533_solr
[junit4:junit4]   2> 6406 T1398 C100 P44533 REQ /get {distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=0 
[junit4:junit4]   2> 6455 T1366 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 6456 T1366 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:41231
[junit4:junit4]   2> 6457 T1366 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 6457 T1366 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty4-1355310269199
[junit4:junit4]   2> 6457 T1366 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty4-1355310269199/'
[junit4:junit4]   2> 6469 T1366 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 6469 T1366 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 6469 T1366 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty4-1355310269199
[junit4:junit4]   2> 6470 T1366 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty4-1355310269199/solr.xml
[junit4:junit4]   2> 6470 T1366 oasc.CoreContainer.<init> New CoreContainer 28375356
[junit4:junit4]   2> 6470 T1366 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty4-1355310269199/'
[junit4:junit4]   2> 6471 T1366 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty4-1355310269199/'
[junit4:junit4]   2> 6482 T1366 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 6491 T1366 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:55662/solr
[junit4:junit4]   2> 6492 T1366 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 6492 T1366 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:55662 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@17fc3f9
[junit4:junit4]   2> 6493 T1366 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6493 T1449 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:55662. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 6493 T1449 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:55662, initiating session
[junit4:junit4]   2> 6493 T1368 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:57836
[junit4:junit4]   2> 6494 T1368 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:57836
[junit4:junit4]   2> 6494 T1370 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8ec96a12000a with negotiated timeout 20000 for client /127.0.0.1:57836
[junit4:junit4]   2> 6494 T1449 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:55662, sessionid = 0x13b8ec96a12000a, negotiated timeout = 20000
[junit4:junit4]   2> 6495 T1450 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@17fc3f9 name:ZooKeeperConnection Watcher:127.0.0.1:55662 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6495 T1366 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6496 T1371 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8ec96a12000a
[junit4:junit4]   2> 6496 T1450 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 6496 T1368 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:57836 which had sessionid 0x13b8ec96a12000a
[junit4:junit4]   2> 6496 T1366 oaz.ZooKeeper.close Session: 0x13b8ec96a12000a closed
[junit4:junit4]   2> 6497 T1366 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:55662/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@1b8c348
[junit4:junit4]   2> 6497 T1451 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:55662. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 6497 T1366 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6498 T1451 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:55662, initiating session
[junit4:junit4]   2> 6498 T1368 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:57837
[junit4:junit4]   2> 6498 T1368 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:57837
[junit4:junit4]   2> 6498 T1370 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8ec96a12000b with negotiated timeout 8000 for client /127.0.0.1:57837
[junit4:junit4]   2> 6498 T1451 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:55662, sessionid = 0x13b8ec96a12000b, negotiated timeout = 8000
[junit4:junit4]   2> 6499 T1452 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b8c348 name:ZooKeeperConnection Watcher:127.0.0.1:55662/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6499 T1366 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6500 T1371 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ec96a12000b type:create cxid:0x1 zxid:0xa2 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6500 T1371 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ec96a12000b type:create cxid:0x2 zxid:0xa3 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6501 T1366 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41231_solr
[junit4:junit4]   2> 6501 T1371 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ec96a12000b type:delete cxid:0x4 zxid:0xa4 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:41231_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:41231_solr
[junit4:junit4]   2> 6502 T1366 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:41231_solr
[junit4:junit4]   2> 6503 T1420 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6503 T1405 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6503 T1388 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6504 T1435 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 6504 T1435 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6505 T1366 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 6505 T1366 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 6505 T1366 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 6506 T1366 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 6506 T1366 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 6507 T1420 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 6507 T1388 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 6507 T1366 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 6507 T1405 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 6507 T1366 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 6507 T1366 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 6508 T1366 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 6508 T1366 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 6512 T1366 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 6517 T1453 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty4-1355310269199/collection1
[junit4:junit4]   2> 6518 T1453 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 6518 T1453 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 6518 T1453 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 6519 T1453 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty4-1355310269199/collection1/'
[junit4:junit4]   2> 6519 T1453 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/solrtest-jetty4-1355310269199/collection1/lib/README' to classloader
[junit4:junit4]   2> 6519 T1453 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/solrtest-jetty4-1355310269199/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 6550 T1453 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 6604 T1453 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 6605 T1453 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 6609 T1453 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 6622 T1389 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6623 T1389 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:50889_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:50889/solr"}
[junit4:junit4]   2> 6626 T1420 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6627 T1405 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6627 T1388 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6626 T1435 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6627 T1452 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7014 T1453 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 7020 T1453 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 7022 T1453 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 7032 T1453 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 7035 T1453 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 7041 T1453 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 7042 T1453 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 7044 T1453 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-jetty4-1355310269199/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355310262799/jetty4/
[junit4:junit4]   2> 7044 T1453 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@15ed659
[junit4:junit4]   2> 7045 T1453 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355310262799/jetty4/index/
[junit4:junit4]   2> 7046 T1453 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355310262799/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 7047 T1453 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1355310262799/jetty4/index forceNew:false
[junit4:junit4]   2> 7053 T1453 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1355310262799/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@60d510; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 7053 T1453 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 7053 T1453 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 7056 T1453 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 7056 T1453 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 7057 T1453 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 7057 T1453 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 7058 T1453 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 7058 T1453 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 7058 T1453 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 7060 T1453 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 7061 T1453 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 7062 T1453 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 7063 T1453 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 7064 T1453 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 7065 T1453 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 7065 T1453 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 7066 T1453 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 7067 T1453 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 7069 T1453 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7070 T1453 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7071 T1453 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7071 T1453 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7072 T1453 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7073 T1453 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7073 T1453 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7074 T1453 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 7075 T1453 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 7076 T1453 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 7078 T1453 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 7079 T1453 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 7081 T1453 oass.SolrIndexSearcher.<init> Opening Searcher@df7aa6 main
[junit4:junit4]   2> 7081 T1453 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 7082 T1453 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 7082 T1453 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 7082 T1453 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 7086 T1453 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 7109 T1454 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@df7aa6 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 7115 T1453 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 7115 T1453 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 7130 T1389 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7131 T1389 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:41231_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:41231/solr"}
[junit4:junit4]   2> 7131 T1389 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 7131 T1389 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4]   2> 7135 T1420 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7135 T1405 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7135 T1435 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7135 T1388 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7135 T1452 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7617 T1453 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 7617 T1453 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:41231/solr shardId:shard2
[junit4:junit4]   2> 7619 T1453 oasc.ZkController.register We are http://127.0.0.1:41231/solr/collection1/ and leader is http://127.0.0.1:53458/solr/collection1/
[junit4:junit4]   2> 7619 T1453 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:41231/solr
[junit4:junit4]   2> 7620 T1453 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 7620 T1453 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C101 name=collection1 org.apache.solr.core.SolrCore@1201ddb url=http://127.0.0.1:41231/solr/collection1 node=127.0.0.1:41231_solr
[junit4:junit4]   2> 7620 T1455 C101 P41231 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 7620 T1455 C101 P41231 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 7620 T1453 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7621 T1455 C101 P41231 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 7621 T1455 C101 P41231 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 7621 T1366 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   2> 7622 T1455 C101 P41231 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:53458/solr/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 7622 T1366 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 7622 T1455 C101 P41231 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:41231/solr START replicas=[http://127.0.0.1:53458/solr/collection1/] nUpdates=100
[junit4:junit4]   2> 7622 T1366 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 7622 T1455 C101 P41231 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 7623 T1455 C101 P41231 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 7623 T1455 C101 P41231 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 7623 T1455 C101 P41231 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 7625 T1366 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:55662/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1091ef6
[junit4:junit4]   2> 7625 T1366 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 7625 T1457 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:55662. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 7626 T1457 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:55662, initiating session
[junit4:junit4]   2> 7626 T1368 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:57841
[junit4:junit4]   2> 7626 T1368 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:57841
[junit4:junit4]   2> 7627 T1370 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8ec96a12000c with negotiated timeout 10000 for client /127.0.0.1:57841
[junit4:junit4]   2> 7627 T1457 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:55662, sessionid = 0x13b8ec96a12000c, negotiated timeout = 10000
[junit4:junit4]   2> ASYNC  NEW_CORE C102 name=collection1 org.apache.solr.core.SolrCore@a25509 url=http://127.0.0.1:53458/solr/collection1 node=127.0.0.1:53458_solr
[junit4:junit4]   2> 7627 T1416 C102 P53458 REQ /get {distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=0 
[junit4:junit4]   2> 7627 T1458 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1091ef6 name:ZooKeeperConnection Watcher:127.0.0.1:55662/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 7628 T1366 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 7628 T1366 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 7630 T1366 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 7630 T1366 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 7632 T1366 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7633 T1366 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):540
[junit4:junit4]   2> 7633 T1366 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7639 T1389 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7639 T1389 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:41231_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:41231/solr"}
[junit4:junit4]   2> 7642 T1420 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7642 T1388 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7642 T1452 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7643 T1405 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7643 T1435 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7643 T1458 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8635 T1366 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2>  C99_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:50889_solr, base_url=http://127.0.0.1:50889/solr}
[junit4:junit4]   2> 9404 T1438 C99 P50889 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 9405 T1438 C99 P50889 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 9405 T1438 C99 P50889 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:44533/solr/collection1/. core=collection1
[junit4:junit4]   2> 9405 T1438 C99 P50889 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 9410 T1398 C100 P44533 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 9414 T1398 C100 P44533 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1355310262799/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@668c55; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 9415 T1398 C100 P44533 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 9419 T1398 C100 P44533 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1355310262799/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@668c55; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1355310262799/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@668c55; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 9420 T1398 C100 P44533 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 9421 T1398 C100 P44533 oass.SolrIndexSearcher.<init> Opening Searcher@bccd5e realtime
[junit4:junit4]   2> 9421 T1398 C100 P44533 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 9422 T1398 C100 P44533 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 9423 T1398 C100 P44533 /update {waitSearcher=true&openSearcher=false&commit=true&commit_end_point=true&wt=javabin&softCommit=false&version=2} {commit=} 0 13
[junit4:junit4]   2> 9424 T1438 C99 P50889 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 9424 T1438 C99 P50889 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 9427 T1401 C100 P44533 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 9428 T1401 C100 P44533 REQ /replication {command=indexversion&wt=javabin&qt=/replication&version=2} status=0 QTime=2 
[junit4:junit4]   2> 9428 T1438 C99 P50889 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 9429 T1438 C99 P50889 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 9429 T1438 C99 P50889 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 9431 T1398 C100 P44533 REQ /replication {command=filelist&generation=2&wt=javabin&qt=/replication&version=2} status=0 QTime=0 
[junit4:junit4]   2> 9432 T1438 C99 P50889 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 9433 T1438 C99 P50889 oash.SnapPuller.fetchLatestIndex Starting download to ./org.apache.solr.cloud.BasicDistributedZkTest-1355310262799/jetty3/index.20121212220432228 fullCopy=true
[junit4:junit4]   2> 9436 T1399 C100 P44533 REQ /replication {file=segments_2&command=filecontent&checksum=true&generation=2&qt=/replication&wt=filestream} status=0 QTime=1 
[junit4:junit4]   2> 9439 T1438 C99 P50889 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 9449 T1438 C99 P50889 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20121212220432228
[junit4:junit4]   2> 9450 T1438 C99 P50889 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.BasicDistributedZkTest-1355310262799/jetty3/index/ new=./org.apache.solr.cloud.BasicDistributedZkTest-1355310262799/jetty3/index.20121212220432228
[junit4:junit4]   2> 9451 T1438 C99 P50889 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1355310262799/jetty3/index.20121212220432228 forceNew:false
[junit4:junit4]   2> 9453 T1438 C99 P50889 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1355310262799/jetty3/index.20121212220432228 lockFactory=org.apache.lucene.store.NativeFSLockFactory@11fb2c7; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 9454 T1438 C99 P50889 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 9455 T1438 C99 P50889 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 9455 T1438 C99 P50889 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 9455 T1438 C99 P50889 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4]   2> 9456 T1438 C99 P50889 oasc.CachingDirectoryFactory.close Closing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1355310262799/jetty3/index.20121212220432228
[junit4:junit4]   2> 9457 T1438 C99 P50889 oash.SnapPuller$2.onClose removing old index directory ./org.apache.solr.cloud.BasicDistributedZkTest-1355310262799/jetty3/index
[junit4:junit4]   2> 9458 T1438 C99 P50889 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1355310262799/jetty3/index.20121212220432228 forceNew:true
[junit4:junit4]   2> 9460 T1438 C99 P50889 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1355310262799/jetty3/index.20121212220432228 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1cb6146; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 9461 T1438 C99 P50889 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 9461 T1438 C99 P50889 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 9462 T1438 C99 P50889 oass.SolrIndexSearcher.<init> Opening Searcher@760424 main
[junit4:junit4]   2> 9462 T1438 C99 P50889 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 9464 T1437 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@760424 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 9465 T1438 C99 P50889 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 9481 T1438 C99 P50889 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1355310262799/jetty3/index.20121212220432228 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1cb6146; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1355310262799/jetty3/index.20121212220432228 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1cb6146; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 9482 T1438 C99 P50889 oasc.SolrDeletionPolicy.updateCommits newest commit = 3
[junit4:junit4]   2> 9483 T1438 C99 P50889 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 9483 T1438 C99 P50889 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 9483 T1438 C99 P50889 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 9483 T1438 C99 P50889 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 9483 T1438 C99 P50889 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 9485 T1438 C99 P50889 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 9637 T1366 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9652 T1389 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9654 T1389 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:50889_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:50889/solr"}
[junit4:junit4]   2> 9670 T1420 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9670 T1452 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9670 T1405 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9670 T1388 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9670 T1458 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9670 T1435 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2>  C101_STATE=coll:collection1 core:collection1 props:{shard=shard2, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:41231_solr, base_url=http://127.0.0.1:41231/solr}
[junit4:junit4]   2> 10626 T1455 C101 P41231 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 10627 T1455 C101 P41231 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 10627 T1455 C101 P41231 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:53458/solr/collection1/. core=collection1
[junit4:junit4]   2> 10627 T1455 C101 P41231 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 10633 T1416 C102 P53458 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 10638 T1416 C102 P53458 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1355310262799/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1253766; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 10639 T1416 C102 P53458 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 10640 T1366 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10649 T1416 C102 P53458 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1355310262799/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1253766; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1355310262799/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1253766; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 10650 T1416 C102 P53458 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 10651 T1416 C102 P53458 oass.SolrIndexSearcher.<init> Opening Searcher@864143 realtime
[junit4:junit4]   2> 10652 T1416 C102 P53458 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 10652 T1416 C102 P53458 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 10653 T1416 C102 P53458 /update {waitSearcher=true&openSearcher=false&commit=true&commit_end_point=true&wt=javabin&softCommit=false&version=2} {commit=} 0 20
[junit4:junit4]   2> 10654 T1455 C101 P41231 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 10655 T1455 C101 P41231 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 10657 T1413 C102 P53458 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 10658 T1413 C102 P53458 REQ /replication {command=indexversion&wt=javabin&qt=/replication&version=2} status=0 QTime=2 
[junit4:junit4]   2> 10659 T1455 C101 P41231 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 10659 T1455 C101 P41231 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 10659 T1455 C101 P41231 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 10661 T1416 C102 P53458 REQ /replication {command=filelist&generation=2&wt=javabin&qt=/replication&version=2} status=0 QTime=0 
[junit4:junit4]   2> 10662 T1455 C101 P41231 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 10663 T1455 C101 P41231 oash.SnapPuller.fetchLatestIndex Starting download to ./org.apache.solr.cloud.BasicDistributedZkTest-1355310262799/jetty4/index.20121212220433458 fullCopy=true
[junit4:junit4]   2> 10666 T1415 C102 P53458 REQ /replication {file=segments_2&command=filecontent&checksum=true&generation=2&qt=/replication&wt=filestream} status=0 QTime=1 
[junit4:junit4]   2> 10669 T1455 C101 P41231 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 10679 T1455 C101 P41231 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20121212220433458
[junit4:junit4]   2> 10680 T1455 C101 P41231 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.BasicDistributedZkTest-1355310262799/jetty4/index/ new=./org.apache.solr.cloud.BasicDistributedZkTest-1355310262799/jetty4/index.20121212220433458
[junit4:junit4]   2> 10681 T1455 C101 P41231 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1355310262799/jetty4/index.20121212220433458 forceNew:false
[junit4:junit4]   2> 10683 T1455 C101 P41231 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1355310262799/jetty4/index.20121212220433458 lockFactory=org.apache.lucene.store.NativeFSLockFactory@26c0e9; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 10684 T1455 C101 P41231 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 10684 T1455 C101 P41231 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 10685 T1455 C101 P41231 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 10685 T1455 C101 P41231 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4]   2> 10686 T1455 C101 P41231 oasc.CachingDirectoryFactory.close Closing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1355310262799/jetty4/index.20121212220433458
[junit4:junit4]   2> 10686 T1455 C101 P41231 oash.SnapPuller$2.onClose removing old index directory ./org.apache.solr.cloud.BasicDistributedZkTest-1355310262799/jetty4/index
[junit4:junit4]   2> 10687 T1455 C101 P41231 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1355310262799/jetty4/index.20121212220433458 forceNew:true
[junit4:junit4]   2> 10689 T1455 C101 P41231 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1355310262799/jetty4/index.20121212220433458 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5b069c; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 10690 T1455 C101 P41231 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 10690 T1455 C101 P41231 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 10691 T1455 C101 P41231 oass.SolrIndexSearcher.<init> Opening Searcher@1459cbd main
[junit4:junit4]   2> 10691 T1455 C101 P41231 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 10693 T1454 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1459cbd main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 10694 T1455 C101 P41231 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 10721 T1455 C101 P41231 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1355310262799/jetty4/index.20121212220433458 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5b069c; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1355310262799/jetty4/index.20121212220433458 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5b069c; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 10722 T1455 C101 P41231 oasc.SolrDeletionPolicy.updateCommits newest commit = 3
[junit4:junit4]   2> 10722 T1455 C101 P41231 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 10723 T1455 C101 P41231 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 10723 T1455 C101 P41231 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 10723 T1455 C101 P41231 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 10723 T1455 C101 P41231 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 10725 T1455 C101 P41231 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 11183 T1389 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 11184 T1389 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:41231_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:41231/solr"}
[junit4:junit4]   2> 11190 T1420 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 11191 T1435 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 11190 T1452 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 11190 T1458 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 11190 T1405 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 11190 T1388 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 11642 T1366 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> ASYNC  NEW_CORE C103 name=collection1 org.apache.solr.core.SolrCore@2570bd url=http://127.0.0.1:49005/solr/collection1 node=127.0.0.1:49005_solr
[junit4:junit4]   2> 11654 T1384 C103 P49005 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1355310262799/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1bd751f; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 11654 T1384 C103 P49005 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 11655 T1384 C103 P49005 oass.SolrIndexSearcher.<init> Opening Searcher@1686560 realtime
[junit4:junit4]   2> 11655 T1384 C103 P49005 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 11656 T1384 C103 P49005 /update {wt=javabin&version=2} {deleteByQuery=*:* (-1421145826339586048)} 0 4
[junit4:junit4]   2> 11656 T1366 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:55662/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@d7c2f9
[junit4:junit4]   2> 11657 T1461 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:55662. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 11657 T1366 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 11657 T1461 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:55662, initiating session
[junit4:junit4]   2> 11658 T1368 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:57856
[junit4:junit4]   2> 11658 T1368 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:57856
[junit4:junit4]   2> 11659 T1370 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8ec96a12000d with negotiated timeout 10000 for client /127.0.0.1:57856
[junit4:junit4]   2> 11659 T1461 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:55662, sessionid = 0x13b8ec96a12000d, negotiated timeout = 10000
[junit4:junit4]   2> 11659 T1462 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d7c2f9 name:ZooKeeperConnection Watcher:127.0.0.1:55662/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 11659 T1366 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 11660 T1366 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2>  C99_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:50889_solr, base_url=http://127.0.0.1:50889/solr}
[junit4:junit4]   2> 11669 T1431 C99 P50889 REQ /update {update.distrib=FROMLEADER&_version_=-1421145826350071808&update.from=http://127.0.0.1:44533/solr/collection1/&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2>  C101_STATE=coll:collection1 core:collection1 props:{shard=shard2, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:41231_solr, base_url=http://127.0.0.1:41231/solr}
[junit4:junit4]   2> 11672 T1448 C101 P41231 REQ /update {update.distrib=FROMLEADER&_version_=-1421145826351120384&update.from=http://127.0.0.1:53458/solr/collection1/&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 11673 T1415 C102 P53458 REQ /update {update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=10 
[junit4:junit4]   2> 11674 T1398 C100 P44533 /update {wt=javabin&version=2} {deleteByQuery=*:* (-1421145826350071808)} 0 12
[junit4:junit4]   2> 11679 T1381 C103 P49005 /update {wt=javabin&version=2} {add=[1 (1421145826364751872)]} 0 3
[junit4:junit4]   2> 11690 T1429 C99 P50889 REQ /update {distrib.from=http://127.0.0.1:44533/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=3 
[junit4:junit4]   2> 11690 T1399 C100 P44533 REQ /update {distrib.from=http://127.0.0.1:53458/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=8 
[junit4:junit4]   2> 11691 T1413 C102 P53458 /update {wt=javabin&version=2} {add=[1]} 0 10
[junit4:junit4]   2> 11695 T1382 C103 P49005 /update {wt=javabin&version=2} {add=[2 (1421145826383626240)]} 0 1
[junit4:junit4]   2> 11704 T1447 C101 P41231 REQ /update {distrib.from=http://127.0.0.1:53458/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=3 
[junit4:junit4]   2> 11705 T1416 C102 P53458 /update {wt=javabin&version=2} {add=[2 (1421145826386771968)]} 0 8
[junit4:junit4]   2> 11709 T1383 C103 P49005 /update {wt=javabin&version=2} {add=[3 (1421145826397257728)]} 0 2
[junit4:junit4]   2> 11715 T1445 C101 P41231 REQ /update {distrib.from=http://127.0.0.1:53458/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11715 T1415 C102 P53458 REQ /update {distrib.from=http://127.0.0.1:44533/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=3 
[junit4:junit4]   2> 11716 T1400 C100 P44533 /update {wt=javabin&version=2} {add=[3]} 0 5
[junit4:junit4]   2> 11718 T1384 C103 P49005 /update {wt=javabin&version=2} {add=[4 (1421145826407743488)]} 0 1
[junit4:junit4]   2> 11724 T1428 C99 P50889 REQ /update {distrib.from=http://127.0.0.1:44533/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11724 T1401 C100 P44533 REQ /update {distrib.from=http://127.0.0.1:53458/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=3 
[junit4:junit4]   2> 11725 T1414 C102 P53458 /update {wt=javabin&version=2} {add=[4]} 0 5
[junit4:junit4]   2> 11727 T1381 C103 P49005 /update {wt=javabin&version=2} {add=[5 (1421145826417180672)]} 0 1
[junit4:junit4]   2> 11733 T1446 C101 P41231 REQ /update {distrib.from=http://127.0.0.1:53458/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11734 T1413 C102 P53458 REQ /update {distrib.from=http://127.0.0.1:44533/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=4 
[junit4:junit4]   2> 11734 T1398 C100 P44533 /update {wt=javabin&version=2} {add=[5]} 0 6
[junit4:junit4]   2> 11736 T1382 C103 P49005 /update {wt=javabin&version=2} {add=[6 (1421145826427666432)]} 0 0
[junit4:junit4]   2> 11741 T1448 C101 P41231 REQ /update {distrib.from=http://127.0.0.1:53458/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11741 T1416 C102 P53458 /update {wt=javabin&version=2} {add=[6 (1421145826429763584)]} 0 3
[junit4:junit4]   2> 11743 T1383 C103 P49005 /update {wt=javabin&version=2} {add=[7 (1421145826435006464)]} 0 0
[junit4:junit4]   2> 11748 T1447 C101 P41231 REQ /update {distrib.from=http://127.0.0.1:53458/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 11749 T1415 C102 P53458 REQ /update {distrib.from=http://127.0.0.1:44533/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=3 
[junit4:junit4]   2> 11749 T1399 C100 P44533 /update {wt=javabin&version=2} {add=[7]} 0 4
[junit4:junit4]   2> 11751 T1384 C103 P49005 /update {wt=javabin&version=2} {add=[8 (1421145826443395072)]} 0 0
[junit4:junit4]   2> 11757 T1430 C99 P50889 REQ /update {distrib.from=http://127.0.0.1:44533/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11758 T1400 C100 P44533 REQ /update {distrib.from=http://127.0.0.1:53458/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=4 
[junit4:junit4]   2> 11758 T1414 C102 P53458 /update {wt=javabin&version=2} {add=[8]} 0 5
[junit4:junit4]   2> 11760 T1381 C103 P49005 /update {wt=javabin&version=2} {add=[9 (1421145826452832256)]} 0 0
[junit4:junit4]   2> 11765 T1445 C101 P41231 REQ /update {distrib.from=http://127.0.0.1:53458/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11765 T1413 C102 P53458 /update {wt=javabin&version=2} {add=[9 (1421145826454929408)]} 0 3
[junit4:junit4]   2> 11781 T1382 C103 P49005 /update {wt=javabin&version=2} {add=[10 (1421145826460172288)]} 0 14
[junit4:junit4]   2> 11788 T1431 C99 P50889 REQ /update {distrib.from=http://127.0.0.1:44533/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 11788 T1401 C100 P44533 /update {wt=javabin&version=2} {add=[10 (1421145826477998080)]} 0 5
[junit4:junit4]   2> 11792 T1383 C103 P49005 /update {wt=javabin&version=2} {add=[11 (1421145826484289536)]} 0 2
[junit4:junit4]   2> 11798 T1429 C99 P50889 REQ /update {distrib.from=http://127.0.0.1:44533/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11798 T1398 C100 P44533 REQ /update {distrib.from=http://127.0.0.1:53458/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=3 
[junit4:junit4]   2> 11799 T1416 C102 P53458 /update {wt=javabin&version=2} {add=[11]} 0 6
[junit4:junit4]   2> 11802 T1384 C103 P49005 /update {wt=javabin&version=2} {add=[12 (1421145826495823872)]} 0 1
[junit4:junit4]   2> 11807 T1428 C99 P50889 REQ /update {distrib.from=http://127.0.0.1:44533/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11808 T1399 C100 P44533 /update {wt=javabin&version=2} {add=[12 (1421145826498969600)]} 0 4
[junit4:junit4]   2> 11811 T1381 C103 P49005 /update {wt=javabin&version=2} {add=[13 (1421145826505261056)]} 0 1
[junit4:junit4]   2> 11818 T1430 C99 P50889 REQ /update {distrib.from=http://127.0.0.1:44533/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 11818 T1400 C100 P44533 /update {wt=javabin&version=2} {add=[13 (1421145826508406784)]} 0 5
[junit4:junit4]   2> 11822 T1382 C103 P49005 /update {wt=javabin&version=2} {add=[14 (1421145826516795392)]} 0 1
[junit4:junit4]   2> 11830 T1431 C99 P50889 REQ /update {distrib.from=http://127.0.0.1:44533/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11830 T1401 C100 P44533 REQ /update {distrib.from=http://127.0.0.1:53458/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=4 
[junit4:junit4]   2> 11831 T1415 C102 P53458 /update {wt=javabin&version=2} {add=[14]} 0 7
[junit4:junit4]   2> 11834 T1383 C103 P49005 /update {wt=javabin&version=2} {add=[15 (1421145826529378304)]} 0 1
[junit4:junit4]   2> 11842 T1429 C99 P50889 REQ /update {distrib.from=http://127.0.0.1:44533/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11842 T1398 C100 P44533 REQ /update {distrib.from=http://127.0.0.1:53458/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=4 
[junit4:junit4]   2> 11843 T1414 C102 P53458 /update {wt=javabin&version=2} {add=[15]} 0 7
[junit4:junit4]   2> 11846 T1384 C103 P49005 /update {wt=javabin&version=2} {add=[16 (1421145826541961216)]} 0 1
[junit4:junit4]   2> 11886 T1428 C99 P50889 REQ /update {distrib.from=http://127.0.0.1:44533/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=13 
[junit4:junit4]   2> 11887 T1400 C100 P44533 /update {wt=javabin&version=2} {add=[16 (1421145826546155520)]} 0 38
[junit4:junit4]   2> 11890 T1381 C103 P49005 /update {wt=javabin&version=2} {add=[17 (1421145826588098560)]} 0 1
[junit4:junit4]   2> 11897 T1446 C101 P41231 REQ /update {distrib.from=http://127.0.0.1:53458/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11898 T1413 C102 P53458 /update {wt=javabin&version=2} {add=[17 (1421145826591244288)]} 0 6
[junit4:junit4]   2> 11901 T1382 C103 P49005 /update {wt=javabin&version=2} {add=[100 (1421145826599632896)]} 0 1
[junit4:junit4]   2> 11907 T1430 C99 P50889 REQ /update {distrib.from=http://127.0.0.1:44533/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 11907 T1398 C100 P44533 /update {wt=javabin&version=2} {add=[100 (1421145826602778624)]} 0 4
[junit4:junit4]   2> 11910 T1383 C103 P49005 /update {wt=javabin&version=2} {add=[101 (1421145826609070080)]} 0 1
[junit4:junit4]   2> 11916 T1431 C99 P50889 REQ /update {distrib.from=http://127.0.0.1:44533/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11917 T1399 C100 P44533 REQ /update {distrib.from=http://127.0.0.1:53458/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=4 
[junit4:junit4]   2> 11917 T1416 C102 P53458 /update {wt=javabin&version=2} {add=[101]} 0 5
[junit4:junit4]   2> 11935 T1384 C103 P49005 /update {wt=javabin&version=2} {add=[102 (1421145826619555840)]} 0 16
[junit4:junit4]   2> 11941 T1429 C99 P50889 REQ /update {distrib.from=http://127.0.0.1:44533/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11942 T1401 C100 P44533 REQ /update {distrib.from=http://127.0.0.1:53458/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=4 
[junit4:junit4]   2> 11943 T1415 C102 P53458 /update {wt=javabin&version=2} {add=[102]} 0 7
[junit4:junit4]   2> 11945 T1381 C103 P49005 /update {wt=javabin&version=2} {add=[103 (1421145826645770240)]} 0 1
[junit4:junit4]   2> 11952 T1448 C101 P41231 REQ /update {distrib.from=http://127.0.0.1:53458/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11953 T1414 C102 P53458 REQ /update {distrib.from=http://127.0.0.1:44533/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=4 
[junit4:junit4]   2> 11953 T1400 C100 P44533 /update {wt=javabin&version=2} {add=[103]} 0 6
[junit4:junit4]   2> 11956 T1382 C103 P49005 /update {wt=javabin&version=2} {add=[104 (1421145826657304576)]} 0 1
[junit4:junit4]   2> 11961 T1447 C101 P41231 REQ /update {distrib.from=http://127.0.0.1:53458/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11961 T1413 C102 P53458 /update {wt=javabin&version=2} {add=[104 (1421145826660450304)]} 0 3
[junit4:junit4]   2> 11992 T1383 C103 P49005 /update {wt=javabin&version=2} {add=[105 (1421145826695053312)]} 0 1
[junit4:junit4]   2> 12034 T1445 C101 P41231 REQ /update {distrib.from=http://127.0.0.1:53458/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=27 
[junit4:junit4]   2> 12034 T1416 C102 P53458 REQ /update {distrib.from=http://127.0.0.1:44533/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=39 
[junit4:junit4]   2> 12035 T1398 C100 P44533 /update {wt=javabin&version=2} {add=[105]} 0 41
[junit4:junit4]   2> 12038 T1381 C103 P49005 /update {wt=javabin&version=2} {add=[106 (1421145826743287808)]} 0 1
[junit4:junit4]   2> 12044 T1446 C101 P41231 REQ /update {distrib.from=http://127.0.0.1:53458/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 12045 T1415 C102 P53458 /update {wt=javabin&version=2} {add=[106 (1421145826746433536)]} 0 5
[junit4:junit4]   2> 12048 T1383 C103 P49005 /update {wt=javabin&version=2} {add=[107 (1421145826753773568)]} 0 1
[junit4:junit4]   2> 12055 T1430 C99 P50889 REQ /update {distrib.from=http://127.0.0.1:44533/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 12056 T1399 C100 P44533 REQ /update {distrib.from=http://127.0.0.1:53458/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=4 
[junit4:junit4]   2> 12057 T1414 C102 P53458 /update {wt=javabin&version=2} {add=[107]} 0 7
[junit4:junit4]   2> 12060 T1384 C103 P49005 /update {wt=javabin&version=2} {add=[108 (1421145826766356480)]} 0 1
[junit4:junit4]   2> 12066 T1429 C99 P50889 REQ /update {distrib.from=http://127.0.0.1:44533/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 12067 T1401 C100 P44533 /update {wt=javabin&version=2} {add=[108 (1421145826769502208)]} 0 5
[junit4:junit4]   2> 12070 T1382 C103 P49005 /update {wt=javabin&version=2} {add=[109 (1421145826776842240)]} 0 1
[junit4:junit4]   2> 12077 T1428 C99 P50889 REQ /update {distrib.from=http://127.0.0.1:44533/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 12078 T1400 C100 P44533 REQ /update {distrib.from=http://127.0.0.1:53458/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=4 
[junit4:junit4]   2> 12078 T1413 C102 P53458 /update {wt=javabin&version=2} {add=[109]} 0 6
[junit4:junit4]   2> 12082 T1381 C103 P49005 /update {wt=javabin&version=2} {add=[110 (1421145826789425152)]} 0 1
[junit4:junit4]   2> 12089 T1431 C99 P50889 REQ /update {distrib.from=http://127.0.0.1:44533/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 12090 T1398 C100 P44533 REQ /update {distrib.from=http://127.0.0.1:53458/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=4 
[junit4:junit4]   2> 12091 T1416 C102 P53458 /update {wt=javabin&version=2} {add=[110]} 0 7
[junit4:junit4]   2> 12094 T1383 C103 P49005 /update {wt=javabin&version=2} {add=[111 (1421145826802008064)]} 0 1
[junit4:junit4]   2> 12103 T1430 C99 P50889 REQ /update {distrib.from=http://127.0.0.1:44533/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 12104 T1399 C100 P44533 REQ /update {distrib.from=http://127.0.0.1:53458/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=5 
[junit4:junit4]   2> 12104 T1414 C102 P53458 /update {wt=javabin&version=2} {add=[111]} 0 8
[junit4:junit4]   2> 12126 T1384 C103 P49005 /update {wt=javabin&version=2} {add=[112 (1421145826816688128)]} 0 19
[junit4:junit4]   2> 12134 T1447 C101 P41231 REQ /update {distrib.from=http://127.0.0.1:53458/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 12135 T1413 C102 P53458 REQ /update {distrib.from=http://127.0.0.1:44533/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=5 
[junit4:junit4]   2> 12135 T1401 C100 P44533 /update {wt=javabin&version=2} {add=[112]} 0 7
[junit4:junit4]   2> 12139 T1382 C103 P49005 /update {wt=javabin&version=2} {add=[113 (1421145826849193984)]} 0 1
[junit4:junit4]   2> 12145 T1429 C99 P50889 REQ /update {distrib.from=http://127.0.0.1:44533/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 12146 T1400 C100 P44533 /update {wt=javabin&version=2} {add=[113 (1421145826853388288)]} 0 4
[junit4:junit4]   2> 12149 T1381 C103 P49005 /update {wt=javabin&version=2} {add=[114 (1421145826859679744)]} 0 1
[junit4:junit4]   2> 12192 T1428 C99 P50889 REQ /update {distrib.from=http://127.0.0.1:44533/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=18 
[junit4:junit4]   2> 12193 T1398 C100 P44533 REQ /update {distrib.from=http://127.0.0.1:53458/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=40 
[junit4:junit4]   2> 12193 T1416 C102 P53458 /update {wt=javabin&version=2} {add=[114]} 0 41
[junit4:junit4]   2> 12196 T1383 C103 P49005 /update {wt=javabin&version=2} {add=[115 (1421145826908962816)]} 0 1
[junit4:junit4]   2> 12203 T1446 C101 P41231 REQ /update {distrib.from=http://127.0.0.1:5345

[...truncated too long message...]

s recoverying - waited for 540 seconds
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([198081057303A3DE:98660F1D045CC3E2]:0)
[junit4:junit4]    > 	at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:165)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:115)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:110)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:563)
[junit4:junit4]    > 	at org.apache.solr.cloud.BasicDistributedZk2Test.brindDownShardIndexSomeDocsAndRecover(BasicDistributedZk2Test.java:321)
[junit4:junit4]    > 	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:83)
[junit4:junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
[junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:597)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:662)
[junit4:junit4]   2> 566677 T2432 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> 566680 T2431 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s).
[junit4:junit4]   2> NOTE: test params are: codec=Lucene40, sim=RandomSimilarityProvider(queryNorm=false,coord=no): {}, locale=es_GT, timezone=Etc/GMT-8
[junit4:junit4]   2> NOTE: Linux 3.2.0-34-generic i386/Sun Microsystems Inc. 1.6.0_37 (32-bit)/cpus=8,threads=1,free=172137096,total=326692864
[junit4:junit4]   2> NOTE: All tests run in this JVM: [TestDocumentBuilder, TestSolrCoreProperties, QueryParsingTest, DocumentBuilderTest, HighlighterTest, FullSolrCloudDistribCmdsTest, IndexSchemaTest, DocumentAnalysisRequestHandlerTest, TestCSVResponseWriter, XmlUpdateRequestHandlerTest, TestQuerySenderListener, TestZkChroot, PolyFieldTest, IndexSchemaRuntimeFieldTest, RequiredFieldsTest, TestReplicationHandler, TestBinaryField, SchemaVersionSpecificBehaviorTest, TestBM25SimilarityFactory, TestSort, PeerSyncTest, ClusterStateTest, ZkSolrClientTest, OutputWriterTest, TestCSVLoader, PingRequestHandlerTest, DirectSolrSpellCheckerTest, TestStressRecovery, SuggesterTSTTest, TestUpdate, DebugComponentTest, TestSolrDeletionPolicy1, RAMDirectoryFactoryTest, TestQueryUtils, StandardRequestHandlerTest, TestSolrJ, URLClassifyProcessorTest, BasicZkTest, TestDocSet, TestReversedWildcardFilterFactory, TestDistributedGrouping, DOMUtilTest, ShowFileRequestHandlerTest, LukeRequestHandlerTest, UpdateParamsTest, TestFuzzyAnalyzedSuggestions, TestRecovery, TermVectorComponentTest, DirectUpdateHandlerTest, TestRTGBase, QueryEqualityTest, TestFunctionQuery, LegacyHTMLStripCharFilterTest, BasicFunctionalityTest, MultiTermTest, SyncSliceTest, RecoveryZkTest, SuggesterTest, BasicDistributedZkTest, IndexBasedSpellCheckerTest, TestMultiCoreConfBootstrap, TestGroupingSearch, FileBasedSpellCheckerTest, ConvertedLegacyTest, QueryElevationComponentTest, SortByFunctionTest, TestBinaryResponseWriter, SampleTest, TestIndexSearcher, TestTrie, DirectSolrConnectionTest, TestRemoteStreaming, CacheHeaderTest, DistributedQueryElevationComponentTest, DisMaxRequestHandlerTest, DistanceFunctionTest, TestSurroundQueryParser, TestSolrQueryParser, TestValueSourceCache, ReturnFieldsTest, TestOmitPositions, LoggingHandlerTest, CSVRequestHandlerTest, NotRequiredUniqueKeyTest, BadIndexSchemaTest, TestFoldingMultitermQuery, TestWriterPerf, PrimitiveFieldTypeTest, TestSolrDeletionPolicy2, TestPropInjectDefaults, TestMergePolicyConfig, SolrIndexConfigTest, TestQuerySenderNoQuery, EchoParamsTest, TestPerFieldSimilarity, TestDFRSimilarityFactory, TestCodecSupport, DateMathParserTest, OpenExchangeRatesOrgProviderTest, TestSystemIdResolver, DateFieldTest, TestSuggestSpellingConverter, TestLRUCache, UUIDFieldTest, TestUtils, PreAnalyzedFieldTest, ZkNodePropsTest, TestCharFilters, TestCollationKeyRangeQueries, BasicDistributedZk2Test]
[junit4:junit4] Completed on J1 in 566.95s, 1 test, 1 failure <<< FAILURES!

[...truncated 11 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:352: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:178: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:438: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1171: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:835: There were test failures: 239 suites, 994 tests, 1 error, 1 failure, 7 ignored (2 assumptions)

Total time: 36 minutes 19 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 32bit/jdk1.6.0_37 -server -XX:+UseSerialGC
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-4.x-Linux (64bit/jdk1.7.0_09) - Build # 3180 - Still Failing!

Posted by Policeman Jenkins Server <je...@sd-datasolutions.de>.
Build: http://jenkins.sd-datasolutions.de/job/Lucene-Solr-4.x-Linux/3180/
Java: 64bit/jdk1.7.0_09 -XX:+UseG1GC

3 tests failed.
FAILED:  org.apache.solr.cloud.SyncSliceTest.testDistribSearch

Error Message:
There are still nodes recoverying - waited for 540 seconds

Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 540 seconds
	at __randomizedtesting.SeedInfo.seed([FE43C54173402529:7FA54B59041F4515]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:165)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:115)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:110)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:563)
	at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:224)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:601)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)


FAILED:  org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch

Error Message:
There are still nodes recoverying - waited for 540 seconds

Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 540 seconds
	at __randomizedtesting.SeedInfo.seed([FE43C54173402529:7FA54B59041F4515]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:165)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:115)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:110)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:563)
	at org.apache.solr.cloud.BasicDistributedZk2Test.brindDownShardIndexSomeDocsAndRecover(BasicDistributedZk2Test.java:321)
	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:83)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:601)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)


FAILED:  org.apache.solr.cloud.BasicDistributedZkTest.testDistribSearch

Error Message:
Server at http://127.0.0.1:45909/solr returned non ok status:500, message:Server Error

Stack Trace:
org.apache.solr.common.SolrException: Server at http://127.0.0.1:45909/solr returned non ok status:500, message:Server Error
	at __randomizedtesting.SeedInfo.seed([FE43C54173402529:7FA54B59041F4515]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:372)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
	at org.apache.solr.client.solrj.request.CoreAdminRequest.process(CoreAdminRequest.java:429)
	at org.apache.solr.client.solrj.request.CoreAdminRequest.getStatus(CoreAdminRequest.java:472)
	at org.apache.solr.cloud.BasicDistributedZkTest.collectStartTimes(BasicDistributedZkTest.java:959)
	at org.apache.solr.cloud.BasicDistributedZkTest.testCollectionsAPI(BasicDistributedZkTest.java:795)
	at org.apache.solr.cloud.BasicDistributedZkTest.doTest(BasicDistributedZkTest.java:343)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:601)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)




Build Log:
[...truncated 8613 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZkTest
[junit4:junit4]   2> 4 T883 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZkTest-1355305268184
[junit4:junit4]   2> 5 T883 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 6 T884 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 7 T884 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 7 T884 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4]   2> 7 T884 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4]   2> 7 T884 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 8 T884 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355305268184/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4]   2> 106 T883 oasc.ZkTestServer.run start zk server on port:60912
[junit4:junit4]   2> 107 T883 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60912 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@627094f5
[junit4:junit4]   2> 108 T883 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 108 T889 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:60912. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 109 T889 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:60912, initiating session
[junit4:junit4]   2> 109 T885 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:38718
[junit4:junit4]   2> 109 T885 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:38718
[junit4:junit4]   2> 110 T887 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 168 T887 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8e7d33db0000 with negotiated timeout 10000 for client /127.0.0.1:38718
[junit4:junit4]   2> 168 T889 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:60912, sessionid = 0x13b8e7d33db0000, negotiated timeout = 10000
[junit4:junit4]   2> 169 T890 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@627094f5 name:ZooKeeperConnection Watcher:127.0.0.1:60912 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 169 T883 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 170 T883 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 176 T888 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8e7d33db0000
[junit4:junit4]   2> 177 T890 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 177 T885 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:38718 which had sessionid 0x13b8e7d33db0000
[junit4:junit4]   2> 177 T883 oaz.ZooKeeper.close Session: 0x13b8e7d33db0000 closed
[junit4:junit4]   2> 179 T883 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60912/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@77221db0
[junit4:junit4]   2> 181 T891 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:60912. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 180 T883 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 181 T891 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:60912, initiating session
[junit4:junit4]   2> 182 T885 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:38719
[junit4:junit4]   2> 182 T885 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:38719
[junit4:junit4]   2> 183 T887 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8e7d33db0001 with negotiated timeout 10000 for client /127.0.0.1:38719
[junit4:junit4]   2> 183 T891 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:60912, sessionid = 0x13b8e7d33db0001, negotiated timeout = 10000
[junit4:junit4]   2> 184 T892 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@77221db0 name:ZooKeeperConnection Watcher:127.0.0.1:60912/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 184 T883 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 185 T883 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 191 T883 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 195 T883 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 199 T883 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 204 T883 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 205 T883 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 213 T883 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 214 T883 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 220 T883 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 222 T883 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 227 T883 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 228 T883 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 233 T883 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 234 T883 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 239 T883 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 241 T883 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 246 T883 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 247 T883 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 252 T883 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 253 T883 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 258 T883 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 260 T883 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 264 T883 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 266 T883 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 271 T888 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8e7d33db0001
[junit4:junit4]   2> 272 T892 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 272 T885 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:38719 which had sessionid 0x13b8e7d33db0001
[junit4:junit4]   2> 272 T883 oaz.ZooKeeper.close Session: 0x13b8e7d33db0001 closed
[junit4:junit4]   2> 343 T883 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 347 T883 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:45909
[junit4:junit4]   2> 347 T883 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 348 T883 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355305268453
[junit4:junit4]   2> 349 T883 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355305268453/'
[junit4:junit4]   2> 361 T883 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 362 T883 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 363 T883 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355305268453
[junit4:junit4]   2> 363 T883 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355305268453/solr.xml
[junit4:junit4]   2> 364 T883 oasc.CoreContainer.<init> New CoreContainer 375873039
[junit4:junit4]   2> 364 T883 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355305268453/'
[junit4:junit4]   2> 365 T883 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355305268453/'
[junit4:junit4]   2> 381 T883 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 390 T883 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:60912/solr
[junit4:junit4]   2> 391 T883 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 392 T883 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60912 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@4edc1427
[junit4:junit4]   2> 393 T902 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:60912. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 392 T883 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 393 T902 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:60912, initiating session
[junit4:junit4]   2> 394 T885 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:38720
[junit4:junit4]   2> 394 T885 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:38720
[junit4:junit4]   2> 395 T887 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8e7d33db0002 with negotiated timeout 20000 for client /127.0.0.1:38720
[junit4:junit4]   2> 395 T902 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:60912, sessionid = 0x13b8e7d33db0002, negotiated timeout = 20000
[junit4:junit4]   2> 395 T903 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4edc1427 name:ZooKeeperConnection Watcher:127.0.0.1:60912 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 395 T883 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 397 T888 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8e7d33db0002
[junit4:junit4]   2> 397 T903 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 397 T885 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:38720 which had sessionid 0x13b8e7d33db0002
[junit4:junit4]   2> 397 T883 oaz.ZooKeeper.close Session: 0x13b8e7d33db0002 closed
[junit4:junit4]   2> 398 T883 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60912/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@3f8aaceb
[junit4:junit4]   2> 399 T904 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:60912. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 399 T883 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 400 T904 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:60912, initiating session
[junit4:junit4]   2> 400 T885 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:38721
[junit4:junit4]   2> 400 T885 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:38721
[junit4:junit4]   2> 401 T887 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8e7d33db0003 with negotiated timeout 8000 for client /127.0.0.1:38721
[junit4:junit4]   2> 401 T904 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:60912, sessionid = 0x13b8e7d33db0003, negotiated timeout = 8000
[junit4:junit4]   2> 402 T905 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3f8aaceb name:ZooKeeperConnection Watcher:127.0.0.1:60912/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 402 T883 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 403 T888 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e7d33db0003 type:create cxid:0x2 zxid:0x1b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 404 T883 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 406 T883 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45909_solr
[junit4:junit4]   2> 407 T888 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e7d33db0003 type:delete cxid:0x7 zxid:0x1d txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:45909_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:45909_solr
[junit4:junit4]   2> 409 T883 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:45909_solr
[junit4:junit4]   2> 413 T883 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 414 T883 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 415 T883 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 416 T883 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 417 T883 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 418 T883 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 419 T883 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 420 T883 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 421 T883 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 422 T883 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 431 T883 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 440 T888 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e7d33db0003 type:delete cxid:0x15 zxid:0x22 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 441 T883 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 445 T883 oasc.Overseer.start Overseer (id=88821286055903235-127.0.0.1:45909_solr-n_0000000000) starting
[junit4:junit4]   2> 447 T888 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e7d33db0003 type:create cxid:0x1a zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 448 T888 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e7d33db0003 type:create cxid:0x1b zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 450 T888 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e7d33db0003 type:create cxid:0x1c zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 451 T888 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e7d33db0003 type:create cxid:0x1d zxid:0x27 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 452 T907 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
[junit4:junit4]   2> 453 T883 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 457 T883 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 462 T906 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 468 T908 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355305268453/collection1
[junit4:junit4]   2> 468 T908 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4]   2> 469 T908 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 470 T908 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4]   2> 472 T908 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355305268453/collection1/'
[junit4:junit4]   2> 473 T908 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355305268453/collection1/lib/README' to classloader
[junit4:junit4]   2> 473 T908 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355305268453/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 518 T908 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 556 T908 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 557 T908 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 561 T908 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 882 T908 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 887 T908 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 890 T908 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 901 T908 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 904 T908 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 907 T908 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 908 T908 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 909 T908 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355305268453/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355305268184/control/data/
[junit4:junit4]   2> 910 T908 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6c031c3d
[junit4:junit4]   2> 916 T908 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355305268184/control/data/index/
[junit4:junit4]   2> 916 T908 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355305268184/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 917 T908 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355305268184/control/data/index forceNew:false
[junit4:junit4]   2> 920 T908 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355305268184/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4971a987),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 921 T908 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 921 T908 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 923 T908 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 923 T908 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 924 T908 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 924 T908 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 924 T908 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 925 T908 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 925 T908 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 926 T908 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 926 T908 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 927 T908 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 927 T908 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 928 T908 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 929 T908 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 929 T908 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 929 T908 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 930 T908 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 931 T908 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 932 T908 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 932 T908 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 933 T908 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 934 T908 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 934 T908 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 935 T908 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 935 T908 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 936 T908 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 938 T908 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 940 T908 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 941 T908 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 943 T908 oass.SolrIndexSearcher.<init> Opening Searcher@d242b3e main
[junit4:junit4]   2> 943 T908 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 944 T908 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 944 T908 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 944 T908 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 948 T908 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 968 T909 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@d242b3e main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 974 T908 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 974 T908 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 975 T888 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e7d33db0003 type:create cxid:0x53 zxid:0x2a txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 979 T908 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 979 T908 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:45909/solr shardId:control_shard
[junit4:junit4]   2> 980 T908 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/control_shard/election
[junit4:junit4]   2> 989 T888 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e7d33db0003 type:delete cxid:0x62 zxid:0x31 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4]   2> 990 T908 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 991 T888 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e7d33db0003 type:create cxid:0x63 zxid:0x32 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1469 T906 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 1470 T906 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":"control_shard",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:45909_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:45909/solr"}
[junit4:junit4]   2> 1471 T888 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e7d33db0003 type:create cxid:0x6a zxid:0x34 txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 1484 T905 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 1494 T908 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 1495 T908 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 1496 T908 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:45909/solr/collection1/
[junit4:junit4]   2> 1497 T908 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 1497 T908 oasc.SyncStrategy.syncToMe http://127.0.0.1:45909/solr/collection1/ has no replicas
[junit4:junit4]   2> 1498 T908 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:45909/solr/collection1/
[junit4:junit4]   2> 1498 T908 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/control_shard
[junit4:junit4]   2> 1505 T888 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e7d33db0003 type:create cxid:0x89 zxid:0x3f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1994 T906 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2002 T905 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 2009 T908 oasc.ZkController.register We are http://127.0.0.1:45909/solr/collection1/ and leader is http://127.0.0.1:45909/solr/collection1/
[junit4:junit4]   2> 2010 T908 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:45909/solr
[junit4:junit4]   2> 2010 T908 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 2011 T908 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 2011 T908 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 2014 T908 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2016 T883 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 2017 T883 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 2018 T883 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 2083 T883 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 2087 T883 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:55131
[junit4:junit4]   2> 2087 T883 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 2089 T883 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355305270204
[junit4:junit4]   2> 2090 T883 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355305270204/'
[junit4:junit4]   2> 2109 T883 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 2110 T883 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 2111 T883 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355305270204
[junit4:junit4]   2> 2111 T883 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355305270204/solr.xml
[junit4:junit4]   2> 2112 T883 oasc.CoreContainer.<init> New CoreContainer 336355292
[junit4:junit4]   2> 2112 T883 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355305270204/'
[junit4:junit4]   2> 2113 T883 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355305270204/'
[junit4:junit4]   2> 2126 T883 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 2135 T883 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:60912/solr
[junit4:junit4]   2> 2135 T883 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 2136 T883 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60912 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@19d178ab
[junit4:junit4]   2> 2137 T919 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:60912. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 2137 T883 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2138 T919 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:60912, initiating session
[junit4:junit4]   2> 2138 T885 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:38723
[junit4:junit4]   2> 2138 T885 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:38723
[junit4:junit4]   2> 2140 T887 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8e7d33db0004 with negotiated timeout 20000 for client /127.0.0.1:38723
[junit4:junit4]   2> 2140 T919 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:60912, sessionid = 0x13b8e7d33db0004, negotiated timeout = 20000
[junit4:junit4]   2> 2140 T920 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@19d178ab name:ZooKeeperConnection Watcher:127.0.0.1:60912 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2140 T883 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2142 T888 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8e7d33db0004
[junit4:junit4]   2> 2143 T920 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 2143 T885 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:38723 which had sessionid 0x13b8e7d33db0004
[junit4:junit4]   2> 2143 T883 oaz.ZooKeeper.close Session: 0x13b8e7d33db0004 closed
[junit4:junit4]   2> 2144 T883 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60912/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@122f50d3
[junit4:junit4]   2> 2145 T921 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:60912. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 2145 T883 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2146 T921 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:60912, initiating session
[junit4:junit4]   2> 2146 T885 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:38724
[junit4:junit4]   2> 2146 T885 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:38724
[junit4:junit4]   2> 2147 T887 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8e7d33db0005 with negotiated timeout 8000 for client /127.0.0.1:38724
[junit4:junit4]   2> 2147 T921 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:60912, sessionid = 0x13b8e7d33db0005, negotiated timeout = 8000
[junit4:junit4]   2> 2148 T922 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@122f50d3 name:ZooKeeperConnection Watcher:127.0.0.1:60912/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2148 T883 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2149 T888 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e7d33db0005 type:create cxid:0x1 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2150 T888 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e7d33db0005 type:create cxid:0x2 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2151 T883 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55131_solr
[junit4:junit4]   2> 2152 T888 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e7d33db0005 type:delete cxid:0x4 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:55131_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:55131_solr
[junit4:junit4]   2> 2153 T883 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55131_solr
[junit4:junit4]   2> 2156 T905 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 2156 T905 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 2157 T883 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 2158 T883 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 2158 T883 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 2159 T883 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 2159 T883 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 2160 T883 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 2161 T883 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 2161 T883 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 2162 T883 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 2162 T883 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 2169 T883 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 2173 T923 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355305270204/collection1
[junit4:junit4]   2> 2174 T923 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 2174 T923 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 2174 T923 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 2175 T923 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355305270204/collection1/'
[junit4:junit4]   2> 2176 T923 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty1-1355305270204/collection1/lib/README' to classloader
[junit4:junit4]   2> 2176 T923 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty1-1355305270204/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 2204 T923 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 2238 T923 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 2239 T923 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 2243 T923 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 2507 T906 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2508 T906 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":"control_shard",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:45909_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:45909/solr"}
[junit4:junit4]   2> 2511 T922 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 2511 T905 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 2564 T923 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 2569 T923 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 2571 T923 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 2583 T923 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 2586 T923 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 2589 T923 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 2590 T923 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 2591 T923 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355305270204/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355305268184/jetty1/
[junit4:junit4]   2> 2591 T923 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6c031c3d
[junit4:junit4]   2> 2592 T923 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355305268184/jetty1/index/
[junit4:junit4]   2> 2592 T923 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355305268184/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 2593 T923 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355305268184/jetty1/index forceNew:false
[junit4:junit4]   2> 2596 T923 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355305268184/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@7bae941c),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 2597 T923 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 2598 T923 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 2600 T923 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 2601 T923 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 2601 T923 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 2602 T923 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 2603 T923 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 2603 T923 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 2604 T923 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 2605 T923 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 2606 T923 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 2607 T923 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 2608 T923 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 2608 T923 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 2609 T923 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 2609 T923 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 2610 T923 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 2610 T923 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 2611 T923 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2612 T923 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2612 T923 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2613 T923 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2614 T923 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2614 T923 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2615 T923 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2616 T923 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 2616 T923 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 2618 T923 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 2620 T923 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 2621 T923 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 2623 T923 oass.SolrIndexSearcher.<init> Opening Searcher@76bad34a main
[junit4:junit4]   2> 2623 T923 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 2624 T923 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 2624 T923 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 2625 T923 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 2628 T923 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 2665 T924 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@76bad34a main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 2674 T923 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 2675 T923 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 3017 T906 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3018 T906 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:55131_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:55131/solr"}
[junit4:junit4]   2> 3019 T906 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4]   2> 3022 T906 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 3029 T905 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3029 T922 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3177 T923 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 3178 T923 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:55131/solr shardId:shard1
[junit4:junit4]   2> 3179 T923 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 3190 T888 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e7d33db0005 type:delete cxid:0x45 zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 3191 T923 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 3192 T888 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e7d33db0005 type:create cxid:0x46 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3195 T923 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 3196 T923 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 3196 T923 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:55131/solr/collection1/
[junit4:junit4]   2> 3197 T923 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 3197 T923 oasc.SyncStrategy.syncToMe http://127.0.0.1:55131/solr/collection1/ has no replicas
[junit4:junit4]   2> 3197 T923 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:55131/solr/collection1/
[junit4:junit4]   2> 3198 T923 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 3205 T888 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e7d33db0005 type:create cxid:0x50 zxid:0x60 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3536 T906 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3550 T905 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3550 T922 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3559 T923 oasc.ZkController.register We are http://127.0.0.1:55131/solr/collection1/ and leader is http://127.0.0.1:55131/solr/collection1/
[junit4:junit4]   2> 3559 T923 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:55131/solr
[junit4:junit4]   2> 3560 T923 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 3560 T923 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 3561 T923 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 3563 T923 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3565 T883 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 3566 T883 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 3567 T883 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 3634 T883 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 3636 T883 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:48989
[junit4:junit4]   2> 3637 T883 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 3638 T883 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355305271754
[junit4:junit4]   2> 3639 T883 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355305271754/'
[junit4:junit4]   2> 3653 T883 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 3654 T883 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 3654 T883 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355305271754
[junit4:junit4]   2> 3655 T883 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355305271754/solr.xml
[junit4:junit4]   2> 3655 T883 oasc.CoreContainer.<init> New CoreContainer 1627127252
[junit4:junit4]   2> 3656 T883 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355305271754/'
[junit4:junit4]   2> 3657 T883 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355305271754/'
[junit4:junit4]   2> 3669 T883 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 3679 T883 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:60912/solr
[junit4:junit4]   2> 3680 T883 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 3680 T883 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60912 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@7b8f561f
[junit4:junit4]   2> 3682 T934 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:60912. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 3681 T883 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3682 T934 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:60912, initiating session
[junit4:junit4]   2> 3682 T885 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:38725
[junit4:junit4]   2> 3683 T885 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:38725
[junit4:junit4]   2> 3684 T887 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8e7d33db0006 with negotiated timeout 20000 for client /127.0.0.1:38725
[junit4:junit4]   2> 3684 T934 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:60912, sessionid = 0x13b8e7d33db0006, negotiated timeout = 20000
[junit4:junit4]   2> 3684 T935 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7b8f561f name:ZooKeeperConnection Watcher:127.0.0.1:60912 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3685 T883 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3687 T888 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8e7d33db0006
[junit4:junit4]   2> 3687 T935 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 3688 T885 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:38725 which had sessionid 0x13b8e7d33db0006
[junit4:junit4]   2> 3687 T883 oaz.ZooKeeper.close Session: 0x13b8e7d33db0006 closed
[junit4:junit4]   2> 3689 T883 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60912/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@2d2ef3cb
[junit4:junit4]   2> 3690 T936 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:60912. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 3690 T883 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3690 T936 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:60912, initiating session
[junit4:junit4]   2> 3690 T885 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:38726
[junit4:junit4]   2> 3691 T885 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:38726
[junit4:junit4]   2> 3691 T887 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8e7d33db0007 with negotiated timeout 8000 for client /127.0.0.1:38726
[junit4:junit4]   2> 3691 T936 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:60912, sessionid = 0x13b8e7d33db0007, negotiated timeout = 8000
[junit4:junit4]   2> 3692 T937 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2d2ef3cb name:ZooKeeperConnection Watcher:127.0.0.1:60912/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3692 T883 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3693 T888 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e7d33db0007 type:create cxid:0x1 zxid:0x6d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3694 T888 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e7d33db0007 type:create cxid:0x2 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3695 T883 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48989_solr
[junit4:junit4]   2> 3696 T888 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e7d33db0007 type:delete cxid:0x4 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:48989_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:48989_solr
[junit4:junit4]   2> 3696 T883 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:48989_solr
[junit4:junit4]   2> 3699 T922 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3700 T905 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 3700 T905 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 3700 T883 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 3701 T922 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 3701 T883 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 3702 T883 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 3702 T883 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 3703 T883 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 3703 T883 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 3704 T883 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 3704 T883 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 3705 T883 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 3706 T883 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 3712 T883 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3717 T938 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355305271754/collection1
[junit4:junit4]   2> 3717 T938 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 3718 T938 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 3718 T938 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 3719 T938 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355305271754/collection1/'
[junit4:junit4]   2> 3720 T938 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty2-1355305271754/collection1/lib/README' to classloader
[junit4:junit4]   2> 3720 T938 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty2-1355305271754/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 3771 T938 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 3809 T938 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 3810 T938 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 3814 T938 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 4058 T906 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4059 T906 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:55131_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:55131/solr"}
[junit4:junit4]   2> 4062 T905 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4062 T937 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4062 T922 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4128 T938 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 4133 T938 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 4135 T938 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 4145 T938 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 4148 T938 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 4152 T938 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 4153 T938 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 4154 T938 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355305271754/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355305268184/jetty2/
[junit4:junit4]   2> 4154 T938 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6c031c3d
[junit4:junit4]   2> 4155 T938 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355305268184/jetty2/index/
[junit4:junit4]   2> 4155 T938 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355305268184/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 4156 T938 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355305268184/jetty2/index forceNew:false
[junit4:junit4]   2> 4161 T938 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355305268184/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4cab86af),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 4162 T938 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 4163 T938 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 4165 T938 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 4166 T938 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 4166 T938 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 4167 T938 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 4167 T938 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 4168 T938 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 4168 T938 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 4169 T938 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 4169 T938 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 4170 T938 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 4171 T938 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 4171 T938 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 4172 T938 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 4172 T938 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 4172 T938 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 4173 T938 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 4174 T938 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4174 T938 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4175 T938 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4176 T938 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4176 T938 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4177 T938 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4178 T938 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4179 T938 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 4179 T938 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 4181 T938 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 4183 T938 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 4184 T938 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 4186 T938 oass.SolrIndexSearcher.<init> Opening Searcher@2725ee6a main
[junit4:junit4]   2> 4186 T938 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 4187 T938 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 4187 T938 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 4188 T938 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 4191 T938 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 4217 T939 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2725ee6a main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 4227 T938 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 4227 T938 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 4568 T906 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4569 T906 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:48989_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:48989/solr"}
[junit4:junit4]   2> 4570 T906 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 4570 T906 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4]   2> 4576 T905 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4577 T922 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4576 T937 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4729 T938 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 4730 T938 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:48989/solr shardId:shard2
[junit4:junit4]   2> 4732 T938 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4]   2> 4741 T888 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e7d33db0007 type:delete cxid:0x44 zxid:0x7e txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard2 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard2
[junit4:junit4]   2> 4742 T938 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 4743 T888 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e7d33db0007 type:create cxid:0x45 zxid:0x7f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4746 T938 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 4746 T938 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 4747 T938 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:48989/solr/collection1/
[junit4:junit4]   2> 4747 T938 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 4748 T938 oasc.SyncStrategy.syncToMe http://127.0.0.1:48989/solr/collection1/ has no replicas
[junit4:junit4]   2> 4748 T938 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:48989/solr/collection1/
[junit4:junit4]   2> 4748 T938 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4]   2> 4751 T888 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e7d33db0007 type:create cxid:0x4e zxid:0x82 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5084 T906 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5097 T905 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5097 T937 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5097 T922 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5103 T938 oasc.ZkController.register We are http://127.0.0.1:48989/solr/collection1/ and leader is http://127.0.0.1:48989/solr/collection1/
[junit4:junit4]   2> 5103 T938 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:48989/solr
[junit4:junit4]   2> 5104 T938 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 5104 T938 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 5105 T938 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 5108 T938 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5109 T883 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 5111 T883 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 5112 T883 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 5170 T883 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 5172 T883 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:42090
[junit4:junit4]   2> 5173 T883 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 5174 T883 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355305273298
[junit4:junit4]   2> 5174 T883 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355305273298/'
[junit4:junit4]   2> 5186 T883 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 5187 T883 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 5187 T883 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355305273298
[junit4:junit4]   2> 5188 T883 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355305273298/solr.xml
[junit4:junit4]   2> 5188 T883 oasc.CoreContainer.<init> New CoreContainer 1588085346
[junit4:junit4]   2> 5189 T883 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355305273298/'
[junit4:junit4]   2> 5189 T883 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355305273298/'
[junit4:junit4]   2> 5202 T883 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 5210 T883 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:60912/solr
[junit4:junit4]   2> 5211 T883 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 5211 T883 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60912 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@678b4c48
[junit4:junit4]   2> 5213 T949 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:60912. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 5212 T883 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 5213 T949 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:60912, initiating session
[junit4:junit4]   2> 5213 T885 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:38727
[junit4:junit4]   2> 5214 T885 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:38727
[junit4:junit4]   2> 5214 T887 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8e7d33db0008 with negotiated timeout 20000 for client /127.0.0.1:38727
[junit4:junit4]   2> 5214 T949 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:60912, sessionid = 0x13b8e7d33db0008, negotiated timeout = 20000
[junit4:junit4]   2> 5215 T950 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@678b4c48 name:ZooKeeperConnection Watcher:127.0.0.1:60912 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 5215 T883 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 5216 T888 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8e7d33db0008
[junit4:junit4]   2> 5217 T950 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 5217 T885 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:38727 which had sessionid 0x13b8e7d33db0008
[junit4:junit4]   2> 5217 T883 oaz.ZooKeeper.close Session: 0x13b8e7d33db0008 closed
[junit4:junit4]   2> 5218 T883 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60912/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@652f5959
[junit4:junit4]   2> 5219 T951 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:60912. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 5218 T883 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 5219 T951 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:60912, initiating session
[junit4:junit4]   2> 5219 T885 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:38728
[junit4:junit4]   2> 5219 T885 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:38728
[junit4:junit4]   2> 5220 T887 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8e7d33db0009 with negotiated timeout 8000 for client /127.0.0.1:38728
[junit4:junit4]   2> 5220 T951 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:60912, sessionid = 0x13b8e7d33db0009, negotiated timeout = 8000
[junit4:junit4]   2> 5221 T952 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@652f5959 name:ZooKeeperConnection Watcher:127.0.0.1:60912/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 5221 T883 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 5222 T888 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e7d33db0009 type:create cxid:0x1 zxid:0x8f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5223 T888 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e7d33db0009 type:create cxid:0x2 zxid:0x90 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5224 T883 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42090_solr
[junit4:junit4]   2> 5224 T888 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e7d33db0009 type:delete cxid:0x4 zxid:0x91 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:42090_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:42090_solr
[junit4:junit4]   2> 5225 T883 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:42090_solr
[junit4:junit4]   2> 5227 T922 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5228 T905 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 5228 T937 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 5228 T905 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5228 T937 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5229 T922 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 5229 T883 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 5230 T883 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 5231 T883 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 5231 T883 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 5232 T883 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 5233 T883 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 5234 T883 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 5235 T883 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 5236 T883 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 5237 T883 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 5247 T883 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 5252 T953 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355305273298/collection1
[junit4:junit4]   2> 5252 T953 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 5253 T953 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 5253 T953 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 5254 T953 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355305273298/collection1/'
[junit4:junit4]   2> 5254 T953 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty3-1355305273298/collection1/lib/README' to classloader
[junit4:junit4]   2> 5254 T953 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty3-1355305273298/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 5281 T953 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 5316 T953 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 5317 T953 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 5321 T953 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 5604 T906 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5605 T906 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:48989_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:48989/solr"}
[junit4:junit4]   2> 5608 T905 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5608 T952 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5608 T937 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5608 T922 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5650 T953 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 5656 T953 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 5658 T953 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 5677 T953 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5682 T953 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5687 T953 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5690 T953 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5692 T953 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355305273298/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355305268184/jetty3/
[junit4:junit4]   2> 5692 T953 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6c031c3d
[junit4:junit4]   2> 5694 T953 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355305268184/jetty3/index/
[junit4:junit4]   2> 5694 T953 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355305268184/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 5696 T953 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355305268184/jetty3/index forceNew:false
[junit4:junit4]   2> 5701 T953 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355305268184/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@22e885d),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 5702 T953 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 5702 T953 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 5705 T953 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 5706 T953 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 5707 T953 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 5707 T953 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 5708 T953 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 5708 T953 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 5709 T953 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 5709 T953 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 5710 T953 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 5711 T953 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 5712 T953 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 5712 T953 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 5713 T953 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 5713 T953 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 5713 T953 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 5714 T953 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 5715 T953 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5716 T953 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5716 T953 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5717 T953 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5718 T953 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5718 T953 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5719 T953 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5720 T953 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 5721 T953 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 5723 T953 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 5725 T953 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 5726 T953 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 5728 T953 oass.SolrIndexSearcher.<init> Opening Searcher@326ddd94 main
[junit4:junit4]   2> 5728 T953 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 5729 T953 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 5729 T953 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 5730 T953 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 5733 T953 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 5760 T954 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@326ddd94 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 5768 T953 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 5768 T953 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 6114 T906 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6115 T906 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:42090_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:42090/solr"}
[junit4:junit4]   2> 6116 T906 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 6116 T906 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 6123 T905 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6123 T937 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6123 T922 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6123 T952 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6271 T953 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 6271 T953 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:42090/solr shardId:shard1
[junit4:junit4]   2> 6276 T953 oasc.ZkController.register We are http://127.0.0.1:42090/solr/collection1/ and leader is http://127.0.0.1:55131/solr/collection1/
[junit4:junit4]   2> 6277 T953 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:42090/solr
[junit4:junit4]   2> 6277 T953 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 6277 T953 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C46 name=collection1 org.apache.solr.core.SolrCore@1e2208c2 url=http://127.0.0.1:42090/solr/collection1 node=127.0.0.1:42090_solr
[junit4:junit4]   2> 6283 T955 C46 P42090 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 6284 T955 C46 P42090 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 6284 T953 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6285 T955 C46 P42090 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 6285 T955 C46 P42090 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 6287 T955 C46 P42090 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:55131/solr/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 6286 T883 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 6288 T883 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 6289 T883 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 6295 T955 C46 P42090 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4]   2> 6306 T955 C46 P42090 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:42090/solr START replicas=[http://127.0.0.1:55131/solr/collection1/] nUpdates=100
[junit4:junit4]   2> 6307 T955 C46 P42090 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 6308 T955 C46 P42090 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 6308 T955 C46 P42090 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 6308 T955 C46 P42090 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C47 name=collection1 org.apache.solr.core.SolrCore@256cc8a7 url=http://127.0.0.1:55131/solr/collection1 node=127.0.0.1:55131_solr
[junit4:junit4]   2> 6313 T916 C47 P55131 REQ /get {distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=1 
[junit4:junit4]   2> 6364 T883 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 6367 T883 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:45749
[junit4:junit4]   2> 6368 T883 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 6368 T883 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355305274479
[junit4:junit4]   2> 6369 T883 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355305274479/'
[junit4:junit4]   2> 6381 T883 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 6382 T883 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 6383 T883 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355305274479
[junit4:junit4]   2> 6383 T883 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355305274479/solr.xml
[junit4:junit4]   2> 6384 T883 oasc.CoreContainer.<init> New CoreContainer 1705916424
[junit4:junit4]   2> 6384 T883 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355305274479/'
[junit4:junit4]   2> 6385 T883 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355305274479/'
[junit4:junit4]   2> 6398 T883 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 6406 T883 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:60912/solr
[junit4:junit4]   2> 6407 T883 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 6408 T883 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60912 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@4d9f787b
[junit4:junit4]   2> 6409 T966 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:60912. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 6409 T883 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6410 T966 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:60912, initiating session
[junit4:junit4]   2> 6410 T885 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:38731
[junit4:junit4]   2> 6410 T885 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:38731
[junit4:junit4]   2> 6412 T887 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8e7d33db000a with negotiated timeout 20000 for client /127.0.0.1:38731
[junit4:junit4]   2> 6412 T966 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:60912, sessionid = 0x13b8e7d33db000a, negotiated timeout = 20000
[junit4:junit4]   2> 6412 T967 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4d9f787b name:ZooKeeperConnection Watcher:127.0.0.1:60912 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6412 T883 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6414 T888 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8e7d33db000a
[junit4:junit4]   2> 6415 T967 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 6415 T885 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:38731 which had sessionid 0x13b8e7d33db000a
[junit4:junit4]   2> 6415 T883 oaz.ZooKeeper.close Session: 0x13b8e7d33db000a closed
[junit4:junit4]   2> 6416 T883 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60912/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@1eb9c31a
[junit4:junit4]   2> 6417 T968 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:60912. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 6417 T883 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6417 T968 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:60912, initiating session
[junit4:junit4]   2> 6417 T885 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:38732
[junit4:junit4]   2> 6418 T885 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:38732
[junit4:junit4]   2> 6418 T887 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8e7d33db000b with negotiated timeout 8000 for client /127.0.0.1:38732
[junit4:junit4]   2> 6418 T968 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:60912, sessionid = 0x13b8e7d33db000b, negotiated timeout = 8000
[junit4:junit4]   2> 6419 T969 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1eb9c31a name:ZooKeeperConnection Watcher:127.0.0.1:60912/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6419 T883 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6420 T888 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e7d33db000b type:create cxid:0x1 zxid:0xa2 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6421 T888 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e7d33db000b type:create cxid:0x2 zxid:0xa3 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6422 T883 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45749_solr
[junit4:junit4]   2> 6423 T888 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e7d33db000b type:delete cxid:0x4 zxid:0xa4 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:45749_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:45749_solr
[junit4:junit4]   2> 6424 T883 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:45749_solr
[junit4:junit4]   2> 6426 T922 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6426 T905 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 6426 T937 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 6426 T952 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 6426 T905 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6426 T937 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6426 T952 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6427 T883 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 6428 T922 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 6428 T883 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 6428 T883 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 6429 T883 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 6430 T883 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 6431 T883 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 6432 T883 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 6433 T883 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 6434 T883 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 6435 T883 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 6443 T883 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 6450 T970 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355305274479/collection1
[junit4:junit4]   2> 6450 T970 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 6451 T970 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 6451 T970 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 6452 T970 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355305274479/collection1/'
[junit4:junit4]   2> 6453 T970 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty4-1355305274479/collection1/lib/README' to classloader
[junit4:junit4]   2> 6453 T970 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty4-1355305274479/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 6486 T970 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 6522 T970 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 6523 T970 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 6527 T970 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 6629 T906 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6630 T906 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:42090_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:42090/solr"}
[junit4:junit4]   2> 6634 T952 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6634 T922 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6634 T937 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6634 T969 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6634 T905 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6837 T970 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 6842 T970 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 6844 T970 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 6862 T970 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 6866 T970 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 6869 T970 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 6871 T970 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 6873 T970 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355305274479/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355305268184/jetty4/
[junit4:junit4]   2> 6874 T970 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6c031c3d
[junit4:junit4]   2> 6874 T970 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355305268184/jetty4/index/
[junit4:junit4]   2> 6875 T970 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355305268184/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 6875 T970 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355305268184/jetty4/index forceNew:false
[junit4:junit4]   2> 6879 T970 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355305268184/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3f89adda),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 6880 T970 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 6880 T970 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 6883 T970 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 6884 T970 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 6884 T970 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 6885 T970 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 6886 T970 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 6886 T970 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 6887 T970 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 6888 T970 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 6890 T970 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 6891 T970 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 6892 T970 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 6893 T970 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 6894 T970 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 6895 T970 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 6895 T970 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 6897 T970 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 6898 T970 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6899 T970 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6901 T970 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6902 T970 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6903 T970 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6905 T970 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6906 T970 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6907 T970 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 6908 T970 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 6910 T970 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 6912 T970 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 6913 T970 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 6915 T970 oass.SolrIndexSearcher.<init> Opening Searcher@4497185c main
[junit4:junit4]   2> 6915 T970 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 6915 T970 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 6916 T970 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 6916 T970 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 6920 T970 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 6945 T971 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4497185c main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 6954 T970 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 6954 T970 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 7140 T906 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7142 T906 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:45749_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:45749/solr"}
[junit4:junit4]   2> 7142 T906 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 7142 T906 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4]   2> 7148 T905 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7148 T937 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7149 T922 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7148 T952 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7148 T969 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7456 T970 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 7457 T970 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:45749/solr shardId:shard2
[junit4:junit4]   2> 7462 T970 oasc.ZkController.register We are http://127.0.0.1:45749/solr/collection1/ and leader is http://127.0.0.1:48989/solr/collection1/
[junit4:junit4]   2> 7463 T970 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:45749/solr
[junit4:junit4]   2> 7463 T970 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 7464 T970 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C48 name=collection1 org.apache.solr.core.SolrCore@714eb1e0 url=http://127.0.0.1:45749/solr/collection1 node=127.0.0.1:45749_solr
[junit4:junit4]   2> 7465 T972 C48 P45749 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 7465 T972 C48 P45749 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 7466 T970 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7466 T972 C48 P45749 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 7466 T972 C48 P45749 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 7468 T972 C48 P45749 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:48989/solr/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 7467 T883 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 7468 T972 C48 P45749 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:45749/solr START replicas=[http://127.0.0.1:48989/solr/collection1/] nUpdates=100
[junit4:junit4]   2> 7469 T972 C48 P45749 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 7469 T883 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 7470 T972 C48 P45749 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 7470 T972 C48 P45749 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 7470 T883 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 7471 T972 C48 P45749 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C49 name=collection1 org.apache.solr.core.SolrCore@4677667d url=http://127.0.0.1:48989/solr/collection1 node=127.0.0.1:48989_solr
[junit4:junit4]   2> 7481 T932 C49 P48989 REQ /get {distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=0 
[junit4:junit4]   2> 7482 T883 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60912/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@23c22742
[junit4:junit4]   2> 7485 T974 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:60912. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 7484 T883 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 7485 T974 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:60912, initiating session
[junit4:junit4]   2> 7486 T885 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:38735
[junit4:junit4]   2> 7486 T885 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:38735
[junit4:junit4]   2> 7487 T887 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8e7d33db000c with negotiated timeout 10000 for client /127.0.0.1:38735
[junit4:junit4]   2> 7487 T974 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:60912, sessionid = 0x13b8e7d33db000c, negotiated timeout = 10000
[junit4:junit4]   2> 7488 T975 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@23c22742 name:ZooKeeperConnection Watcher:127.0.0.1:60912/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 7488 T883 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 7490 T883 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 7496 T883 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 7498 T883 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 7506 T883 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7509 T883 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):540
[junit4:junit4]   2> 7511 T883 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7657 T906 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7659 T906 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:45749_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:45749/solr"}
[junit4:junit4]   2> 7667 T922 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7667 T975 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7667 T952 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7667 T937 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7667 T905 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7667 T969 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8514 T883 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2>  C46_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:42090_solr, base_url=http://127.0.0.1:42090/solr}
[junit4:junit4]   2> 9316 T955 C46 P42090 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 9316 T955 C46 P42090 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 9317 T955 C46 P42090 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:55131/solr/collection1/. core=collection1
[junit4:junit4]   2> 9317 T955 C46 P42090 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 9322 T918 C47 P55131 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16
[junit4:junit4]   2> 9326 T918 C47 P55131 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 9328 T918 C47 P55131 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355305268184/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@7bae941c),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 9329 T918 C47 P55131 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 9336 T918 C47 P55131 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355305268184/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@7bae941c),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355305268184/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@7bae941c),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 9336 T918 C47 P55131 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 9337 T918 C47 P55131 oass.SolrIndexSearcher.<init> Opening Searcher@1de64536 realtime
[junit4:junit4]   2> 9338 T918 C47 P55131 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 9338 T918 C47 P55131 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 9339 T918 C47 P55131 /update {waitSearcher=true&openSearcher=false&commit=true&commit_end_point=true&wt=javabin&softCommit=false&version=2} {commit=} 0 18
[junit4:junit4]   2> 9340 T955 C46 P42090 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 9341 T955 C46 P42090 oascsi.HttpClientUtil.createClient Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
[junit4:junit4]   2> 9347 T955 C46 P42090 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 9350 T916 C47 P55131 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 9350 T916 C47 P55131 REQ /replication {command=indexversion&wt=javabin&qt=/replication&version=2} status=0 QTime=2 
[junit4:junit4]   2> 9352 T955 C46 P42090 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 9352 T955 C46 P42090 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 9352 T955 C46 P42090 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 9355 T918 C47 P55131 REQ /replication {command=filelist&generation=2&wt=javabin&qt=/replication&version=2} status=0 QTime=1 
[junit4:junit4]   2> 9355 T955 C46 P42090 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 9356 T955 C46 P42090 oash.SnapPuller.fetchLatestIndex Starting download to ./org.apache.solr.cloud.BasicDistributedZkTest-1355305268184/jetty3/index.20121212204117535 fullCopy=true
[junit4:junit4]   2> 9362 T915 C47 P55131 REQ /replication {file=segments_2&command=filecontent&checksum=true&generation=2&qt=/replication&wt=filestream} status=0 QTime=1 
[junit4:junit4]   2> 9367 T955 C46 P42090 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 9376 T955 C46 P42090 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20121212204117535
[junit4:junit4]   2> 9377 T955 C46 P42090 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.BasicDistributedZkTest-1355305268184/jetty3/index/ new=./org.apache.solr.cloud.BasicDistributedZkTest-1355305268184/jetty3/index.20121212204117535
[junit4:junit4]   2> 9377 T955 C46 P42090 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355305268184/jetty3/index.20121212204117535 forceNew:false
[junit4:junit4]   2> 9380 T955 C46 P42090 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355305268184/jetty3/index.20121212204117535 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1293ed43),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 9380 T955 C46 P42090 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 9382 T955 C46 P42090 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 9382 T955 C46 P42090 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 9383 T955 C46 P42090 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4]   2> 9383 T955 C46 P42090 oasc.CachingDirectoryFactory.close Closing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355305268184/jetty3/index.20121212204117535
[junit4:junit4]   2> 9384 T955 C46 P42090 oash.SnapPuller$2.onClose removing old index directory ./org.apache.solr.cloud.BasicDistributedZkTest-1355305268184/jetty3/index
[junit4:junit4]   2> 9385 T955 C46 P42090 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355305268184/jetty3/index.20121212204117535 forceNew:true
[junit4:junit4]   2> 9387 T955 C46 P42090 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355305268184/jetty3/index.20121212204117535 lockFactory=org.apache.lucene.store.NativeFSLockFactory@633fc4ee),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 9388 T955 C46 P42090 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 9388 T955 C46 P42090 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 9388 T955 C46 P42090 oass.SolrIndexSearcher.<init> Opening Searcher@6da864fc main
[junit4:junit4]   2> 9388 T955 C46 P42090 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 9390 T954 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6da864fc main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 9390 T955 C46 P42090 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 9407 T955 C46 P42090 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355305268184/jetty3/index.20121212204117535 lockFactory=org.apache.lucene.store.NativeFSLockFactory@633fc4ee),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355305268184/jetty3/index.20121212204117535 lockFactory=org.apache.lucene.store.NativeFSLockFactory@633fc4ee),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 9408 T955 C46 P42090 oasc.SolrDeletionPolicy.updateCommits newest commit = 3
[junit4:junit4]   2> 9408 T955 C46 P42090 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 9408 T955 C46 P42090 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 9409 T955 C46 P42090 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 9409 T955 C46 P42090 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 9409 T955 C46 P42090 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 9410 T955 C46 P42090 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 9516 T883 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9682 T906 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9683 T906 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:42090_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:42090/solr"}
[junit4:junit4]   2> 9696 T905 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9696 T922 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9696 T969 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9696 T975 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9696 T937 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9696 T952 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2>  C48_STATE=coll:collection1 core:collection1 props:{shard=shard2, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:45749_solr, base_url=http://127.0.0.1:45749/solr}
[junit4:junit4]   2> 10482 T972 C48 P45749 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 10483 T972 C48 P45749 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 10483 T972 C48 P45749 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:48989/solr/collection1/. core=collection1
[junit4:junit4]   2> 10483 T972 C48 P45749 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 10494 T933 C49 P48989 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 10498 T933 C49 P48989 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355305268184/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4cab86af),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 10499 T933 C49 P48989 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 10506 T933 C49 P48989 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355305268184/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4cab86af),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355305268184/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4cab86af),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 10507 T933 C49 P48989 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 10508 T933 C49 P48989 oass.SolrIndexSearcher.<init> Opening Searcher@31dc21ae realtime
[junit4:junit4]   2> 10509 T933 C49 P48989 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 10510 T933 C49 P48989 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 10510 T933 C49 P48989 /update {waitSearcher=true&openSearcher=false&commit=true&commit_end_point=true&wt=javabin&softCommit=false&version=2} {commit=} 0 16
[junit4:junit4]   2> 10512 T972 C48 P45749 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 10513 T972 C48 P45749 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 10517 T930 C49 P48989 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 10518 T930 C49 P48989 REQ /replication {command=indexversion&wt=javabin&qt=/replication&version=2} status=0 QTime=2 
[junit4:junit4]   2> 10519 T972 C48 P45749 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 10519 T972 C48 P45749 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 10520 T972 C48 P45749 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 10519 T883 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10523 T933 C49 P48989 REQ /replication {command=filelist&generation=2&wt=javabin&qt=/replication&version=2} status=0 QTime=1 
[junit4:junit4]   2> 10524 T972 C48 P45749 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 10525 T972 C48 P45749 oash.SnapPuller.fetchLatestIndex Starting download to ./org.apache.solr.cloud.BasicDistributedZkTest-1355305268184/jetty4/index.20121212204118704 fullCopy=true
[junit4:junit4]   2> 10529 T931 C49 P48989 REQ /replication {file=segments_2&command=filecontent&checksum=true&generation=2&qt=/replication&wt=filestream} status=0 QTime=1 
[junit4:junit4]   2> 10532 T972 C48 P45749 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 10536 T972 C48 P45749 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20121212204118704
[junit4:junit4]   2> 10537 T972 C48 P45749 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.BasicDistributedZkTest-1355305268184/jetty4/index/ new=./org.apache.solr.cloud.BasicDistributedZkTest-1355305268184/jetty4/index.20121212204118704
[junit4:junit4]   2> 10538 T972 C48 P45749 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355305268184/jetty4/index.20121212204118704 forceNew:false
[junit4:junit4]   2> 10540 T972 C48 P45749 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355305268184/jetty4/index.20121212204118704 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5bd5ad48),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 10541 T972 C48 P45749 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 10542 T972 C48 P45749 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 10542 T972 C48 P45749 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 10543 T972 C48 P45749 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4]   2> 10543 T972 C48 P45749 oasc.CachingDirectoryFactory.close Closing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355305268184/jetty4/index.20121212204118704
[junit4:junit4]   2> 10544 T972 C48 P45749 oash.SnapPuller$2.onClose removing old index directory ./org.apache.solr.cloud.BasicDistributedZkTest-1355305268184/jetty4/index
[junit4:junit4]   2> 10545 T972 C48 P45749 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355305268184/jetty4/index.20121212204118704 forceNew:true
[junit4:junit4]   2> 10548 T972 C48 P45749 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355305268184/jetty4/index.20121212204118704 lockFactory=org.apache.lucene.store.NativeFSLockFactory@c684b7f),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 10548 T972 C48 P45749 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 10549 T972 C48 P45749 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 10549 T972 C48 P45749 oass.SolrIndexSearcher.<init> Opening Searcher@5d15a613 main
[junit4:junit4]   2> 10550 T972 C48 P45749 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 10552 T971 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5d15a613 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 10553 T972 C48 P45749 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 10587 T972 C48 P45749 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355305268184/jetty4/index.20121212204118704 lockFactory=org.apache.lucene.store.NativeFSLockFactory@c684b7f),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355305268184/jetty4/index.20121212204118704 lockFactory=org.apache.lucene.store.NativeFSLockFactory@c684b7f),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 10588 T972 C48 P45749 oasc.SolrDeletionPolicy.updateCommits newest commit = 3
[junit4:junit4]   2> 10589 T972 C48 P45749 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 10589 T972 C48 P45749 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 10590 T972 C48 P45749 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 10590 T972 C48 P45749 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 10590 T972 C48 P45749 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 10592 T972 C48 P45749 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 10705 T906 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10707 T906 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:45749_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:45749/solr"}
[junit4:junit4]   2> 10714 T922 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10714 T952 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10714 T969 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10714 T937 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10714 T905 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10714 T975 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 11522 T883 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> ASYNC  NEW_CORE C50 name=collection1 org.apache.solr.core.SolrCore@4a364558 url=http://127.0.0.1:45909/solr/collection1 node=127.0.0.1:45909_solr
[junit4:junit4]   2> 11532 T898 C50 P45909 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355305268184/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4971a987),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 11533 T898 C50 P45909 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 11535 T898 C50 P45909 oass.SolrIndexSearcher.<init> Opening Searcher@2aa1aca realtime
[junit4:junit4]   2> 11536 T898 C50 P45909 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 11537 T898 C50 P45909 /update {wt=javabin&version=2} {deleteByQuery=*:* (-1421140588975095808)} 0 9
[junit4:junit4]   2> 11538 T883 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60912/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@116ab522
[junit4:junit4]   2> 11541 T978 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:60912. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 11540 T883 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 11541 T978 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:60912, initiating session
[junit4:junit4]   2> 11541 T885 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:38741
[junit4:junit4]   2> 11542 T885 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:38741
[junit4:junit4]   2> 11543 T887 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8e7d33db000d with negotiated timeout 10000 for client /127.0.0.1:38741
[junit4:junit4]   2> 11543 T978 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:60912, sessionid = 0x13b8e7d33db000d, negotiated timeout = 10000
[junit4:junit4]   2> 11543 T979 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@116ab522 name:ZooKeeperConnection Watcher:127.0.0.1:60912/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 11543 T883 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 11546 T883 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2>  C46_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:42090_solr, base_url=http://127.0.0.1:42090/solr}
[junit4:junit4]   2> 11572 T945 C46 P42090 REQ /update {update.distrib=FROMLEADER&_version_=-1421140589002358784&update.from=http://127.0.0.1:55131/solr/collection1/&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2>  C48_STATE=coll:collection1 core:collection1 props:{shard=shard2, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:45749_solr, base_url=http://127.0.0.1:45749/solr}
[junit4:junit4]   2> 11574 T964 C48 P45749 REQ /update {update.distrib=FROMLEADER&_version_=-1421140589015990272&update.from=http://127.0.0.1:48989/solr/collection1/&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11575 T932 C49 P48989 REQ /update {update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=7 
[junit4:junit4]   2> 11576 T915 C47 P55131 /update {wt=javabin&version=2} {deleteByQuery=*:* (-1421140589002358784)} 0 24
[junit4:junit4]   2> 11586 T899 C50 P45909 /update {wt=javabin&version=2} {add=[1 (1421140589031718912)]} 0 4
[junit4:junit4]   2> 11597 T947 C46 P42090 REQ /update {distrib.from=http://127.0.0.1:55131/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 11598 T917 C47 P55131 /update {wt=javabin&version=2} {add=[1 (1421140589038010368)]} 0 9
[junit4:junit4]   2> 11603 T900 C50 P45909 /update {wt=javabin&version=2} {add=[2 (1421140589051641856)]} 0 2
[junit4:junit4]   2> 11611 T963 C48 P45749 REQ /update {distrib.from=http://127.0.0.1:48989/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 11612 T933 C49 P48989 /update {wt=javabin&version=2} {add=[2 (1421140589054787584)]} 0 7
[junit4:junit4]   2> 11617 T898 C50 P45909 /update {wt=javabin&version=2} {add=[3 (1421140589065273344)]} 0 3
[junit4:junit4]   2> 11625 T965 C48 P45749 REQ /update {distrib.from=http://127.0.0.1:48989/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11626 T931 C49 P48989 /update {wt=javabin&version=2} {add=[3 (1421140589070516224)]} 0 6
[junit4:junit4]   2> 11631 T901 C50 P45909 /update {wt=javabin&version=2} {add=[4 (1421140589079953408)]} 0 2
[junit4:junit4]   2> 11644 T945 C46 P42090 REQ /update {distrib.from=http://127.0.0.1:55131/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 11645 T916 C47 P55131 REQ /update {distrib.from=http://127.0.0.1:48989/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=8 
[junit4:junit4]   2> 11646 T932 C49 P48989 /update {wt=javabin&version=2} {add=[4]} 0 12
[junit4:junit4]   2> 11650 T899 C50 P45909 /update {wt=javabin&version=2} {add=[5 (1421140589100924928)]} 0 2
[junit4:junit4]   2> 11660 T964 C48 P45749 REQ /update {distrib.from=http://127.0.0.1:48989/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11661 T930 C49 P48989 REQ /update {distrib.from=http://127.0.0.1:55131/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=6 
[junit4:junit4]   2> 11662 T918 C47 P55131 /update {wt=javabin&version=2} {add=[5]} 0 9
[junit4:junit4]   2> 11667 T900 C50 P45909 /update {wt=javabin&version=2} {add=[6 (1421140589118750720)]} 0 2
[junit4:junit4]   2> 11677 T962 C48 P45749 REQ /update {distrib.from=http://127.0.0.1:48989/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 11678 T933 C49 P48989 REQ /update {distrib.from=http://127.0.0.1:55131/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=6 
[junit4:junit4]   2> 11679 T915 C47 P55131 /update {wt=javabin&version=2} {add=[6]} 0 9
[junit4:junit4]   2> 11683 T898 C50 P45909 /update {wt=javabin&version=2} {add=[7 (1421140589135527936)]} 0 1
[junit4:junit4]   2> 11691 T963 C48 P45749 REQ /update {distrib.from=http://127.0.0.1:48989/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 11692 T931 C49 P48989 /update {wt=javabin&version=2} {add=[7 (1421140589139722240)]} 0 6
[junit4:junit4]   2> 11696 T901 C50 P45909 /update {wt=javabin&version=2} {add=[8 (1421140589149159424)]} 0 1
[junit4:junit4]   2> 11704 T946 C46 P42090 REQ /update {distrib.from=http://127.0.0.1:55131/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11705 T917 C47 P55131 /update {wt=javabin&version=2} {add=[8 (1421140589154402304)]} 0 6
[junit4:junit4]   2> 11709 T899 C50 P45909 /update {wt=javabin&version=2} {add=[9 (1421140589162790912)]} 0 2
[junit4:junit4]   2> 11718 T965 C48 P45749 REQ /update {distrib.from=http://127.0.0.1:48989/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 11719 T932 C49 P48989 /update {wt=javabin&version=2} {add=[9 (1421140589166985216)]} 0 7
[junit4:junit4]   2> 11731 T900 C50 P45909 /update {wt=javabin&version=2} {add=[10 (1421140589178519552)]} 0 9
[junit4:junit4]   2> 11744 T948 C46 P42090 REQ /update {distrib.from=http://127.0.0.1:55131/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11745 T916 C47 P55131 REQ /update {distrib.from=http://127.0.0.1:48989/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=7 
[junit4:junit4]   2> 11746 T930 C49 P48989 /update {wt=javabin&version=2} {add=[10]} 0 11
[junit4:junit4]   2> 11750 T898 C50 P45909 /update {wt=javabin&version=2} {add=[11 (1421140589205782528)]} 0 2
[junit4:junit4]   2> 11759 T947 C46 P42090 REQ /update {distrib.from=http://127.0.0.1:55131/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11760 T918 C47 P55131 /update {wt=javabin&version=2} {add=[11 (1421140589211025408)]} 0 7
[junit4:junit4]   2> 11764 T901 C50 P45909 /update {wt=javabin&version=2} {add=[12 (1421140589220462592)]} 0 2
[junit4:junit4]   2> 11776 T945 C46 P42090 REQ /update {distrib.from=http://127.0.0.1:55131/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 11777 T915 C47 P55131 REQ /update {distrib.from=http://127.0.0.1:48989/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=8 
[junit4:junit4]   2> 11778 T933 C49 P48989 /update {wt=javabin&version=2} {add=[12]} 0 12
[junit4:junit4]   2> 11782 T899 C50 P45909 /update {wt=javabin&version=2} {add=[13 (1421140589239336960)]} 0 2
[junit4:junit4]   2> 11792 T946 C46 P42090 REQ /update {distrib.from=http://127.0.0.1:55131/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 11793 T916 C47 P55131 /update {wt=javabin&version=2} {add=[13 (1421140589244579840)]} 0 8
[junit4:junit4]   2> 11797 T900 C50 P45909 /update {wt=javabin&version=2} {add=[14 (1421140589255065600)]} 0 1
[junit4:junit4]   2> 11805 T948 C46 P42090 REQ /update {distrib.from=http://127.0.0.1:55131/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11806 T918 C47 P55131 REQ /update {distrib.from=http://127.0.0.1:48989/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=5 
[junit4:junit4]   2> 11807 T931 C49 P48989 /update {wt=javabin&version=2} {add=[14]} 0 8
[junit4:junit4]   2> 11811 T898 C50 P45909 /update {wt=javabin&version=2} {add=[15 (1421140589269745664)]} 0 2
[junit4:junit4]   2> 11820 T947 C46 P42090 REQ /update {distrib.from=http://127.0.0.1:55131/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11821 T915 C47 P55131 REQ /update {distrib.from=http://127.0.0.1:48989/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=5 
[junit4:junit4]   2> 11822 T932 C49 P48989 /update {wt=javabin&version=2} {add=[15]} 0 9
[junit4:junit4]   2> 11826 T901 C50 P45909 /update {wt=javabin&version=2} {add=[16 (1421140589285474304)]} 0 1
[junit4:junit4]   2> 11846 T945 C46 P42090 REQ /update {distrib.from=http://127.0.0.1:55131/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=7 
[junit4:junit4]   2> 11847 T917 C47 P55131 REQ /update {distrib.from=http://127.0.0.1:48989/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=16 
[junit4:junit4]   2> 11848 T930 C49 P48989 /update {wt=javabin&version=2} {add=[16]} 0 20
[junit4:junit4]   2> 11855 T899 C50 P45909 /update {wt=javabin&version=2} {add=[17 (1421140589314834432)]} 0 4
[junit4:junit4]   2> 11867 T964 C48 P45749 REQ /update {distrib.from=http://127.0.0.1:48989/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=4 
[junit4:junit4]   2> 11867 T933 C49 P48989 /update {wt=javabin&version=2} {add=[17 (1421140589321125888)]} 0 10
[junit4:junit4]   2> 11871 T900 C50 P45909 /update {wt=javabin&version=2} {add=[100 (1421140589333708800)]} 0 1
[junit4:junit4]   2> 11881 T946 C46 P42090 REQ /update {distrib.from=http://127.0.0.1:55131/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11882 T916 C47 P55131 REQ /update {distrib.from=http://127.0.0.1:48989/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=6 
[junit4:junit4]   2> 11883 T931 C49 P48989 /update {wt=javabin&version=2} {add=[100]} 0 9
[junit4:junit4]   2> 11887 T898 C50 P45909 /update {wt=javabin&version=2} {add=[101 (1421140589349437440)]} 0 2
[junit4:junit4]   2> 11894 T948 C46 P42090 REQ /update {distrib.from=http://127.0.0.1:55131/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11895 T918 C47 P55131 /update {wt=javabin&version=2} {add=[101 (1421140589353631744)]} 0 6
[junit4:junit4]   2> 11905 T901 C50 P45909 /update {wt=javabin&version=2} {add=[102 (1421140589362020352)]} 0 7
[junit4:junit4]   2> 11915 T947 C46 P42090 REQ /update {distrib.from=http://127.0.0.1:55131/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 11916 T915 C47 P55131 REQ /update {distrib.from=http://127.0.0.1:48989/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=5 
[junit4:junit4]   2> 11916 T932 C49 P48989 /update {wt=javabin&version=2} {add=[102]} 0 8
[junit4:junit4]   2> 11921 T899 C50 P45909 /update {wt=javabin&version=2} {add=[103 (1421140589384040448)]} 0 2
[junit4:junit4]   2> 11930 T962 C48 P45749 REQ /update {distrib.from=http://127.0.0.1:48989/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11931 T930 C49 P48989 REQ /update {distrib.from=http://127.0.0.1:55131/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=5 
[junit4:junit4]   2> 11932 T917 C47 P55131 /update {wt=javabin&version=2} {add=[103]} 0 9
[junit4:junit4]   2> 11936 T900 C50 P45909 /update {wt=javabin&version=2} {add=[104 (1421140589400817664)]} 0 1
[junit4:junit4]   2> 11945 T963 C48 P45749 REQ /update {distrib.from=http://127.0.0.1:48989/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11947 T931 C49 P48989 REQ /update {distrib.from=http://127.0.0.1:55131/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=6 
[junit4:junit4]   2> 11947 T916 C47 P55131 /update {wt=javabin&version=2} {add=[104]} 0 8
[junit4:junit4]   2> 11951 T898 C50 P45909 /update {wt=javabin&version=2} {add=[105 (1421140589416546304)]} 0 1
[junit4:junit4]   2> 11971 T965 C48 P45749 REQ /update {distrib.from=http://127.0.0.1:48989/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=7 
[junit4:junit4]   2> 11972 T932 C49 P48989 /update {wt=javabin&version=2} {add=[105 (1421140589421789184)]} 0 18
[junit4:junit4]   2> 11976 T899 C50 P45909 /update {wt=javabin&version=2} {add=[106 (1421140589443809280)]} 0 1
[junit4:junit4]   2> 11987 T964 C48 P45749 REQ /update {distrib.from=http://127.0.0.1:48989/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11988 T933 C49 P48989 REQ /update {distrib.from=http://127.0.0.1:55131/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=6 
[junit4:junit4]   2> 11989 T918 C47 P55131 /update {wt=javabin&version=2} {add=[106]} 0 10
[junit4:junit4]   2> 11993 T900 C50 P45909 /update {wt=javabin&version=2} {add=[107 (1421140589460586496)]} 0 1
[junit4:junit4]   2> 11999 T945 C46 P42090 REQ /update {distrib.from=http://127.0.0.1:55131/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 12000 T917 C47 P55131 /update {wt=javabin&version=2} {add=[107 (1421140589464780800)]} 0 5
[junit4:junit4]   2> 12004 T901 C50 P45909 /update {wt=javabin&version=2} {add=[108 (1421140589472120832)]} 0 1
[junit4:junit4]   2> 12010 T948 C46 P42090 REQ /update {distrib.from=http://127.0.0.1:55131/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 12011 T916 C47 P55131 /update {wt=javabin&version=2} {add=[108 (1421140589475266560)]} 0 5
[junit4:junit4]   2> 12014 T899 C50 P45909 /update {wt=javabin&version=2} {add=[109 (1421140589483655168)]} 0 1
[junit4:junit4]   2> 12023 T947 C46 P42090 REQ /update {distrib.from=http://127.0.0.1:55131/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 12024 T915 C47 P55131 REQ /update {distrib.from=http://127.0.0.1:48989/solr/collection1/&update.distrib=TO

[...truncated too long message...]

5)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:110)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:563)
[junit4:junit4]    > 	at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:224)
[junit4:junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:601)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 581196 T1960 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> NOTE: test params are: codec=SimpleText, sim=RandomSimilarityProvider(queryNorm=false,coord=yes): {}, locale=es_VE, timezone=Mexico/BajaNorte
[junit4:junit4]   2> NOTE: Linux 3.2.0-34-generic amd64/Oracle Corporation 1.7.0_09 (64-bit)/cpus=8,threads=1,free=180279328,total=515899392
[junit4:junit4]   2> NOTE: All tests run in this JVM: [ConvertedLegacyTest, BasicDistributedZk2Test, TestArbitraryIndexDir, SolrCoreTest, UpdateParamsTest, URLClassifyProcessorTest, PathHierarchyTokenizerFactoryTest, FullSolrCloudDistribCmdsTest, RequiredFieldsTest, SolrInfoMBeanTest, TestZkChroot, TestCharFilters, TestQuerySenderListener, OpenExchangeRatesOrgProviderTest, TestReplicationHandler, TestPhraseSuggestions, TestSolrJ, TestSurroundQueryParser, TestDistributedSearch, TestPropInject, TestCSVResponseWriter, TestRemoteStreaming, TestFoldingMultitermQuery, DebugComponentTest, RecoveryZkTest, DocumentAnalysisRequestHandlerTest, TestHashPartitioner, SuggesterTSTTest, RAMDirectoryFactoryTest, TermVectorComponentTest, XsltUpdateRequestHandlerTest, QueryEqualityTest, TestBM25SimilarityFactory, TestJmxIntegration, TestBinaryField, TestSolrDeletionPolicy2, BasicZkTest, HighlighterTest, TestReversedWildcardFilterFactory, StandardRequestHandlerTest, TestDocumentBuilder, DistributedQueryElevationComponentTest, TestRecovery, OutputWriterTest, PrimUtilsTest, LegacyHTMLStripCharFilterTest, TestRTGBase, LukeRequestHandlerTest, DisMaxRequestHandlerTest, TestDistributedGrouping, SpellingQueryConverterTest, TestSolrDeletionPolicy1, SignatureUpdateProcessorFactoryTest, TestCSVLoader, TestStressLucene, SuggesterTest, TestFuzzyAnalyzedSuggestions, PeerSyncTest, BasicFunctionalityTest, TestBinaryResponseWriter, SampleTest, TestFunctionQuery, TestTrie, DirectSolrConnectionTest, CacheHeaderTest, PolyFieldTest, SpatialFilterTest, DocumentBuilderTest, MBeansHandlerTest, CurrencyFieldTest, TestPseudoReturnFields, IndexSchemaTest, BinaryUpdateRequestHandlerTest, QueryParsingTest, TermsComponentTest, MinimalSchemaTest, TestQueryTypes, XmlUpdateRequestHandlerTest, FieldAnalysisRequestHandlerTest, PingRequestHandlerTest, JsonLoaderTest, DirectUpdateHandlerOptimizeTest, IndexSchemaRuntimeFieldTest, TestSolrQueryParser, SolrPluginUtilsTest, TestValueSourceCache, FastVectorHighlighterTest, ReturnFieldsTest, RequestHandlersTest, SearchHandlerTest, TestOmitPositions, SuggesterFSTTest, CopyFieldTest, TestQueryUtils, SolrCmdDistributorTest, UniqFieldsUpdateProcessorFactoryTest, CSVRequestHandlerTest, ShowFileRequestHandlerTest, TestSearchPerf, NotRequiredUniqueKeyTest, BadIndexSchemaTest, TestWriterPerf, PrimitiveFieldTypeTest, FieldMutatingUpdateProcessorTest, TestUpdate, TestPropInjectDefaults, DefaultValueUpdateProcessorTest, TestMergePolicyConfig, TestDocSet, TestLFUCache, SolrIndexConfigTest, TestQuerySenderNoQuery, IndexReaderFactoryTest, TestNumberUtils, MultiTermTest, TestSolrCoreProperties, TestJmxMonitoredMap, EchoParamsTest, TestLMDirichletSimilarityFactory, TestPluginEnable, TestLMJelinekMercerSimilarityFactory, TestDFRSimilarityFactory, TestCodecSupport, TestDefaultSimilarityFactory, TimeZoneUtilsTest, DateMathParserTest, PluginInfoTest, FileUtilsTest, TestSolrXMLSerializer, DateFieldTest, TestSuggestSpellingConverter, DOMUtilTest, TestLRUCache, UUIDFieldTest, TestUtils, ZkNodePropsTest, CircularListTest, AnalysisAfterCoreReloadTest, TestCollationKeyRangeQueries, ClusterStateTest, ClusterStateUpdateTest, OverseerCollectionProcessorTest, SyncSliceTest]
[junit4:junit4] Completed on J1 in 581.21s, 1 test, 1 failure <<< FAILURES!

[...truncated 58 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:352: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:178: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:438: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1171: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:835: There were test failures: 239 suites, 994 tests, 1 error, 2 failures, 7 ignored (2 assumptions)

Total time: 53 minutes 9 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 64bit/jdk1.7.0_09 -XX:+UseG1GC
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-4.x-Linux (32bit/jdk1.7.0_09) - Build # 3179 - Still Failing!

Posted by Policeman Jenkins Server <je...@sd-datasolutions.de>.
Build: http://jenkins.sd-datasolutions.de/job/Lucene-Solr-4.x-Linux/3179/
Java: 32bit/jdk1.7.0_09 -server -XX:+UseSerialGC

3 tests failed.
FAILED:  org.apache.solr.cloud.SyncSliceTest.testDistribSearch

Error Message:
There are still nodes recoverying - waited for 540 seconds

Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 540 seconds
	at __randomizedtesting.SeedInfo.seed([9625D754350C60BE:17C3594C42530082]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:165)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:115)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:110)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:563)
	at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:224)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:601)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)


FAILED:  org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch

Error Message:
There are still nodes recoverying - waited for 540 seconds

Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 540 seconds
	at __randomizedtesting.SeedInfo.seed([9625D754350C60BE:17C3594C42530082]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:165)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:115)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:110)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:563)
	at org.apache.solr.cloud.BasicDistributedZk2Test.brindDownShardIndexSomeDocsAndRecover(BasicDistributedZk2Test.java:321)
	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:83)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:601)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)


FAILED:  org.apache.solr.cloud.BasicDistributedZkTest.testDistribSearch

Error Message:
Server at http://127.0.0.1:45666/solr returned non ok status:500, message:Server Error

Stack Trace:
org.apache.solr.common.SolrException: Server at http://127.0.0.1:45666/solr returned non ok status:500, message:Server Error
	at __randomizedtesting.SeedInfo.seed([9625D754350C60BE:17C3594C42530082]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:372)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
	at org.apache.solr.client.solrj.request.CoreAdminRequest.process(CoreAdminRequest.java:429)
	at org.apache.solr.client.solrj.request.CoreAdminRequest.getStatus(CoreAdminRequest.java:472)
	at org.apache.solr.cloud.BasicDistributedZkTest.collectStartTimes(BasicDistributedZkTest.java:959)
	at org.apache.solr.cloud.BasicDistributedZkTest.testCollectionsAPI(BasicDistributedZkTest.java:795)
	at org.apache.solr.cloud.BasicDistributedZkTest.doTest(BasicDistributedZkTest.java:343)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:601)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)




Build Log:
[...truncated 8538 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZkTest
[junit4:junit4]   2> 3 T368 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZkTest-1355301186831
[junit4:junit4]   2> 5 T368 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 7 T369 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 25 T369 oaz.Environment.logEnv Server environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
[junit4:junit4]   2> 25 T369 oaz.Environment.logEnv Server environment:host.name=serv1
[junit4:junit4]   2> 25 T369 oaz.Environment.logEnv Server environment:java.version=1.7.0_09
[junit4:junit4]   2> 25 T369 oaz.Environment.logEnv Server environment:java.vendor=Oracle Corporation
[junit4:junit4]   2> 25 T369 oaz.Environment.logEnv Server environment:java.home=/mnt/ssd/jenkins/tools/java/32bit/jdk1.7.0_09/jre
[junit4:junit4]   2> 26 T369 oaz.Environment.logEnv Server environment:java.class.path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/test:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/codecs/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-solrj/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/common/lucene-analyzers-common-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/highlighter/lucene-highlighter-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/memory/lucene-memory-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/misc/lucene-misc-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/spatial/lucene-spatial-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/suggest/lucene-suggest-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/grouping/lucene-grouping-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queries/lucene-queries-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queryparser/lucene-queryparser-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/cglib-nodep-2.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-cli-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-codec-1.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-fileupload-1.2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-lang-2.6.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/easymock-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/guava-13.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/javax.servlet-api-3.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/metrics-core-2.1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/objenesis-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/spatial4j-0.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/commons-io-2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpclient-4.1.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpcore-4.1.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpmime-4.1.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/jcl-over-slf4j-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/log4j-over-slf4j-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-api-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-jdk14-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/wstx-asl-3.2.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/zookeeper-3.4.5.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-continuation-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-deploy-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-http-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-io-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-jmx-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-security-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-server-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-servlet-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-util-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-webapp-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-xml-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/servlet-api-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/hsqldb-1.8.0.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/junit-4.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/randomizedtesting-runner-2.0.5.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-launcher.jar:/var/lib/jenkins/.ant/lib/ivy-2.2.0.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jdepend.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-netrexx.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-antlr.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-commons-net.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-javamail.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-regexp.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jsch.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-xalan2.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-junit4.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jmf.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-junit.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-bcel.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jai.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-commons-logging.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-resolver.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-oro.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-swing.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-bsf.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-log4j.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-testutil.jar:/mnt/ssd/jenkins/tools/java/32bit/jdk1.7.0_09/lib/tools.jar:/var/lib/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.0.5.jar
[junit4:junit4]   2> 26 T369 oaz.Environment.logEnv Server environment:java.library.path=/usr/lib/jvm/j2sdk1.6-sun/jre/lib/amd64/server:/usr/lib/jvm/j2sdk1.6-sun/jre/lib/amd64:/usr/lib/jvm/j2sdk1.6-sun/jre/../lib/amd64:/usr/java/packages/lib/i386:/lib:/usr/lib
[junit4:junit4]   2> 27 T369 oaz.Environment.logEnv Server environment:java.io.tmpdir=.
[junit4:junit4]   2> 27 T369 oaz.Environment.logEnv Server environment:java.compiler=<NA>
[junit4:junit4]   2> 27 T369 oaz.Environment.logEnv Server environment:os.name=Linux
[junit4:junit4]   2> 27 T369 oaz.Environment.logEnv Server environment:os.arch=i386
[junit4:junit4]   2> 27 T369 oaz.Environment.logEnv Server environment:os.version=3.2.0-34-generic
[junit4:junit4]   2> 27 T369 oaz.Environment.logEnv Server environment:user.name=jenkins
[junit4:junit4]   2> 27 T369 oaz.Environment.logEnv Server environment:user.home=/var/lib/jenkins
[junit4:junit4]   2> 27 T369 oaz.Environment.logEnv Server environment:user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 38 T369 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 38 T369 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4]   2> 38 T369 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4]   2> 39 T369 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 60 T369 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355301186831/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4]   2> 107 T368 oasc.ZkTestServer.run start zk server on port:55023
[junit4:junit4]   2> 126 T368 oaz.Environment.logEnv Client environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
[junit4:junit4]   2> 126 T368 oaz.Environment.logEnv Client environment:host.name=serv1
[junit4:junit4]   2> 127 T368 oaz.Environment.logEnv Client environment:java.version=1.7.0_09
[junit4:junit4]   2> 127 T368 oaz.Environment.logEnv Client environment:java.vendor=Oracle Corporation
[junit4:junit4]   2> 127 T368 oaz.Environment.logEnv Client environment:java.home=/mnt/ssd/jenkins/tools/java/32bit/jdk1.7.0_09/jre
[junit4:junit4]   2> 127 T368 oaz.Environment.logEnv Client environment:java.class.path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/test:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/codecs/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-solrj/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/common/lucene-analyzers-common-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/highlighter/lucene-highlighter-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/memory/lucene-memory-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/misc/lucene-misc-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/spatial/lucene-spatial-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/suggest/lucene-suggest-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/grouping/lucene-grouping-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queries/lucene-queries-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queryparser/lucene-queryparser-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/cglib-nodep-2.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-cli-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-codec-1.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-fileupload-1.2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-lang-2.6.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/easymock-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/guava-13.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/javax.servlet-api-3.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/metrics-core-2.1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/objenesis-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/spatial4j-0.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/commons-io-2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpclient-4.1.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpcore-4.1.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpmime-4.1.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/jcl-over-slf4j-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/log4j-over-slf4j-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-api-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-jdk14-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/wstx-asl-3.2.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/zookeeper-3.4.5.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-continuation-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-deploy-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-http-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-io-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-jmx-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-security-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-server-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-servlet-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-util-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-webapp-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-xml-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/servlet-api-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/hsqldb-1.8.0.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/junit-4.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/randomizedtesting-runner-2.0.5.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-launcher.jar:/var/lib/jenkins/.ant/lib/ivy-2.2.0.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jdepend.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-netrexx.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-antlr.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-commons-net.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-javamail.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-regexp.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jsch.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-xalan2.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-junit4.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jmf.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-junit.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-bcel.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jai.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-commons-logging.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-resolver.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-oro.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-swing.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-bsf.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-log4j.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-testutil.jar:/mnt/ssd/jenkins/tools/java/32bit/jdk1.7.0_09/lib/tools.jar:/var/lib/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.0.5.jar
[junit4:junit4]   2> 128 T368 oaz.Environment.logEnv Client environment:java.library.path=/usr/lib/jvm/j2sdk1.6-sun/jre/lib/amd64/server:/usr/lib/jvm/j2sdk1.6-sun/jre/lib/amd64:/usr/lib/jvm/j2sdk1.6-sun/jre/../lib/amd64:/usr/java/packages/lib/i386:/lib:/usr/lib
[junit4:junit4]   2> 129 T368 oaz.Environment.logEnv Client environment:java.io.tmpdir=.
[junit4:junit4]   2> 129 T368 oaz.Environment.logEnv Client environment:java.compiler=<NA>
[junit4:junit4]   2> 129 T368 oaz.Environment.logEnv Client environment:os.name=Linux
[junit4:junit4]   2> 129 T368 oaz.Environment.logEnv Client environment:os.arch=i386
[junit4:junit4]   2> 130 T368 oaz.Environment.logEnv Client environment:os.version=3.2.0-34-generic
[junit4:junit4]   2> 130 T368 oaz.Environment.logEnv Client environment:user.name=jenkins
[junit4:junit4]   2> 130 T368 oaz.Environment.logEnv Client environment:user.home=/var/lib/jenkins
[junit4:junit4]   2> 130 T368 oaz.Environment.logEnv Client environment:user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 132 T368 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:55023 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1701229
[junit4:junit4]   2> 151 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 154 T374 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:55023. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 155 T374 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:55023, initiating session
[junit4:junit4]   2> 155 T370 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:42356
[junit4:junit4]   2> 162 T370 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:42356
[junit4:junit4]   2> 166 T372 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 257 T372 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8e3eed510000 with negotiated timeout 10000 for client /127.0.0.1:42356
[junit4:junit4]   2> 257 T374 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:55023, sessionid = 0x13b8e3eed510000, negotiated timeout = 10000
[junit4:junit4]   2> 260 T375 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1701229 name:ZooKeeperConnection Watcher:127.0.0.1:55023 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 260 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 261 T368 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 283 T373 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8e3eed510000
[junit4:junit4]   2> 284 T375 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 284 T368 oaz.ZooKeeper.close Session: 0x13b8e3eed510000 closed
[junit4:junit4]   2> 285 T370 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:42356 which had sessionid 0x13b8e3eed510000
[junit4:junit4]   2> 285 T368 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:55023/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@13f2f11
[junit4:junit4]   2> 286 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 286 T376 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:55023. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 286 T376 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:55023, initiating session
[junit4:junit4]   2> 286 T370 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:42357
[junit4:junit4]   2> 287 T370 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:42357
[junit4:junit4]   2> 288 T372 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8e3eed510001 with negotiated timeout 10000 for client /127.0.0.1:42357
[junit4:junit4]   2> 288 T376 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:55023, sessionid = 0x13b8e3eed510001, negotiated timeout = 10000
[junit4:junit4]   2> 288 T377 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@13f2f11 name:ZooKeeperConnection Watcher:127.0.0.1:55023/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 288 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 291 T368 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 295 T368 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 297 T368 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 300 T368 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 302 T368 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 310 T368 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 315 T368 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 316 T368 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 319 T368 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 319 T368 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 326 T368 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 326 T368 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 329 T368 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 330 T368 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 333 T368 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 333 T368 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 336 T368 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 336 T368 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 340 T368 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 340 T368 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 343 T368 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 344 T368 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 346 T368 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 347 T368 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 350 T373 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8e3eed510001
[junit4:junit4]   2> 350 T377 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 350 T368 oaz.ZooKeeper.close Session: 0x13b8e3eed510001 closed
[junit4:junit4]   2> 350 T370 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:42357 which had sessionid 0x13b8e3eed510001
[junit4:junit4]   2> 416 T368 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 422 T368 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:45666
[junit4:junit4]   2> 423 T368 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 423 T368 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355301187179
[junit4:junit4]   2> 424 T368 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355301187179/'
[junit4:junit4]   2> 439 T368 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 440 T368 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 440 T368 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355301187179
[junit4:junit4]   2> 441 T368 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355301187179/solr.xml
[junit4:junit4]   2> 441 T368 oasc.CoreContainer.<init> New CoreContainer 9929671
[junit4:junit4]   2> 442 T368 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355301187179/'
[junit4:junit4]   2> 442 T368 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355301187179/'
[junit4:junit4]   2> 459 T368 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 470 T368 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:55023/solr
[junit4:junit4]   2> 478 T368 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 479 T368 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:55023 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1130d55
[junit4:junit4]   2> 480 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 480 T387 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:55023. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 480 T387 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:55023, initiating session
[junit4:junit4]   2> 480 T370 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:42358
[junit4:junit4]   2> 481 T370 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:42358
[junit4:junit4]   2> 482 T372 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8e3eed510002 with negotiated timeout 20000 for client /127.0.0.1:42358
[junit4:junit4]   2> 482 T387 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:55023, sessionid = 0x13b8e3eed510002, negotiated timeout = 20000
[junit4:junit4]   2> 483 T388 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1130d55 name:ZooKeeperConnection Watcher:127.0.0.1:55023 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 483 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 484 T373 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8e3eed510002
[junit4:junit4]   2> 485 T370 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:42358 which had sessionid 0x13b8e3eed510002
[junit4:junit4]   2> 485 T388 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 485 T368 oaz.ZooKeeper.close Session: 0x13b8e3eed510002 closed
[junit4:junit4]   2> 486 T368 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:55023/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@e1e519
[junit4:junit4]   2> 487 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 487 T389 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:55023. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 487 T389 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:55023, initiating session
[junit4:junit4]   2> 488 T370 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:42359
[junit4:junit4]   2> 488 T370 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:42359
[junit4:junit4]   2> 488 T372 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8e3eed510003 with negotiated timeout 8000 for client /127.0.0.1:42359
[junit4:junit4]   2> 488 T389 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:55023, sessionid = 0x13b8e3eed510003, negotiated timeout = 8000
[junit4:junit4]   2> 489 T390 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e1e519 name:ZooKeeperConnection Watcher:127.0.0.1:55023/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 489 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 496 T373 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e3eed510003 type:create cxid:0x2 zxid:0x1b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 499 T368 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 501 T368 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45666_solr
[junit4:junit4]   2> 503 T373 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e3eed510003 type:delete cxid:0x7 zxid:0x1d txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:45666_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:45666_solr
[junit4:junit4]   2> 504 T368 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:45666_solr
[junit4:junit4]   2> 506 T368 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 507 T368 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 507 T368 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 507 T368 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 508 T368 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 508 T368 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 508 T368 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 508 T368 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 509 T368 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 509 T368 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 513 T368 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 522 T373 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e3eed510003 type:delete cxid:0x15 zxid:0x22 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 523 T368 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 527 T368 oasc.Overseer.start Overseer (id=88821018584481795-127.0.0.1:45666_solr-n_0000000000) starting
[junit4:junit4]   2> 527 T373 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e3eed510003 type:create cxid:0x1a zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 531 T373 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e3eed510003 type:create cxid:0x1b zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 532 T373 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e3eed510003 type:create cxid:0x1c zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 535 T373 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e3eed510003 type:create cxid:0x1d zxid:0x27 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 536 T392 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
[junit4:junit4]   2> 536 T368 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 538 T368 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 545 T391 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 558 T393 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355301187179/collection1
[junit4:junit4]   2> 558 T393 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4]   2> 559 T393 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 559 T393 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4]   2> 561 T393 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355301187179/collection1/'
[junit4:junit4]   2> 561 T393 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355301187179/collection1/lib/README' to classloader
[junit4:junit4]   2> 561 T393 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355301187179/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 591 T393 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 652 T393 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 653 T393 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 658 T393 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 1012 T393 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 1018 T393 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 1020 T393 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 1037 T393 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1040 T393 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1043 T393 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1045 T393 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1047 T393 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355301187179/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355301186831/control/data/
[junit4:junit4]   2> 1047 T393 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@429664
[junit4:junit4]   2> 1048 T393 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355301186831/control/data/index/
[junit4:junit4]   2> 1048 T393 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355301186831/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 1049 T393 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355301186831/control/data/index forceNew:false
[junit4:junit4]   2> 1052 T393 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355301186831/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@296ba8; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 1052 T393 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 1053 T393 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 1054 T393 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 1054 T393 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 1055 T393 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 1055 T393 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 1055 T393 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 1055 T393 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 1056 T393 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 1056 T393 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 1057 T393 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 1058 T393 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 1059 T393 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 1059 T393 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 1060 T393 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 1060 T393 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 1060 T393 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 1061 T393 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 1061 T393 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1062 T393 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1063 T393 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1063 T393 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1064 T393 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1065 T393 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1066 T393 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1066 T393 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 1067 T393 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 1069 T393 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 1070 T393 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 1072 T393 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 1074 T393 oass.SolrIndexSearcher.<init> Opening Searcher@35c83d main
[junit4:junit4]   2> 1074 T393 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 1074 T393 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 1075 T393 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 1075 T393 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 1079 T393 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 1098 T394 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@35c83d main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 1102 T393 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 1102 T393 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 1103 T373 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e3eed510003 type:create cxid:0x53 zxid:0x2a txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 1106 T393 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 1106 T393 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:45666/solr shardId:control_shard
[junit4:junit4]   2> 1109 T393 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4]   2> 1113 T393 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/control_shard/election
[junit4:junit4]   2> 1121 T373 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e3eed510003 type:delete cxid:0x62 zxid:0x31 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4]   2> 1122 T393 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 1122 T373 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e3eed510003 type:create cxid:0x63 zxid:0x32 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1552 T391 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 1553 T391 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":"control_shard",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:45666_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:45666/solr"}
[junit4:junit4]   2> 1556 T373 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e3eed510003 type:create cxid:0x6a zxid:0x34 txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 1569 T390 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 1625 T393 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 1625 T393 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 1625 T393 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:45666/solr/collection1/
[junit4:junit4]   2> 1626 T393 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 1626 T393 oasc.SyncStrategy.syncToMe http://127.0.0.1:45666/solr/collection1/ has no replicas
[junit4:junit4]   2> 1626 T393 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:45666/solr/collection1/
[junit4:junit4]   2> 1626 T393 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/control_shard
[junit4:junit4]   2> 1637 T373 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e3eed510003 type:create cxid:0x89 zxid:0x3f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2076 T391 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2082 T390 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 2091 T393 oasc.ZkController.register We are http://127.0.0.1:45666/solr/collection1/ and leader is http://127.0.0.1:45666/solr/collection1/
[junit4:junit4]   2> 2091 T393 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:45666/solr
[junit4:junit4]   2> 2091 T393 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 2091 T393 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 2092 T393 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 2094 T393 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2095 T368 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 2096 T368 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 2096 T368 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 2145 T368 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 2146 T368 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:33920
[junit4:junit4]   2> 2147 T368 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 2148 T368 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355301188927
[junit4:junit4]   2> 2148 T368 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355301188927/'
[junit4:junit4]   2> 2159 T368 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 2159 T368 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 2160 T368 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355301188927
[junit4:junit4]   2> 2160 T368 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355301188927/solr.xml
[junit4:junit4]   2> 2160 T368 oasc.CoreContainer.<init> New CoreContainer 23033444
[junit4:junit4]   2> 2161 T368 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355301188927/'
[junit4:junit4]   2> 2161 T368 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355301188927/'
[junit4:junit4]   2> 2172 T368 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 2180 T368 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:55023/solr
[junit4:junit4]   2> 2180 T368 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 2181 T368 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:55023 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1a5ea25
[junit4:junit4]   2> 2181 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2182 T404 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:55023. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 2182 T404 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:55023, initiating session
[junit4:junit4]   2> 2182 T370 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:42361
[junit4:junit4]   2> 2183 T370 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:42361
[junit4:junit4]   2> 2183 T372 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8e3eed510004 with negotiated timeout 20000 for client /127.0.0.1:42361
[junit4:junit4]   2> 2183 T404 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:55023, sessionid = 0x13b8e3eed510004, negotiated timeout = 20000
[junit4:junit4]   2> 2184 T405 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1a5ea25 name:ZooKeeperConnection Watcher:127.0.0.1:55023 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2184 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2185 T373 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8e3eed510004
[junit4:junit4]   2> 2186 T405 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 2186 T370 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:42361 which had sessionid 0x13b8e3eed510004
[junit4:junit4]   2> 2186 T368 oaz.ZooKeeper.close Session: 0x13b8e3eed510004 closed
[junit4:junit4]   2> 2186 T368 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:55023/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@1a8184
[junit4:junit4]   2> 2187 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2187 T406 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:55023. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 2188 T406 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:55023, initiating session
[junit4:junit4]   2> 2188 T370 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:42362
[junit4:junit4]   2> 2188 T370 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:42362
[junit4:junit4]   2> 2189 T372 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8e3eed510005 with negotiated timeout 8000 for client /127.0.0.1:42362
[junit4:junit4]   2> 2189 T406 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:55023, sessionid = 0x13b8e3eed510005, negotiated timeout = 8000
[junit4:junit4]   2> 2189 T407 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1a8184 name:ZooKeeperConnection Watcher:127.0.0.1:55023/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2189 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2190 T373 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e3eed510005 type:create cxid:0x1 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2191 T373 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e3eed510005 type:create cxid:0x2 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2192 T368 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33920_solr
[junit4:junit4]   2> 2192 T373 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e3eed510005 type:delete cxid:0x4 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:33920_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:33920_solr
[junit4:junit4]   2> 2193 T368 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:33920_solr
[junit4:junit4]   2> 2195 T390 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 2195 T390 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 2196 T368 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 2196 T368 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 2196 T368 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 2197 T368 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 2197 T368 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 2197 T368 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 2198 T368 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 2198 T368 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 2198 T368 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 2199 T368 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 2205 T368 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 2211 T408 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355301188927/collection1
[junit4:junit4]   2> 2211 T408 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 2211 T408 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 2212 T408 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 2213 T408 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355301188927/collection1/'
[junit4:junit4]   2> 2213 T408 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty1-1355301188927/collection1/lib/README' to classloader
[junit4:junit4]   2> 2213 T408 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty1-1355301188927/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 2244 T408 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 2284 T408 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 2285 T408 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 2289 T408 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 2587 T391 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2588 T391 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":"control_shard",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:45666_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:45666/solr"}
[junit4:junit4]   2> 2592 T390 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 2592 T407 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 2607 T408 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 2612 T408 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 2615 T408 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 2629 T408 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 2633 T408 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 2635 T408 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 2637 T408 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 2638 T408 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355301188927/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355301186831/jetty1/
[junit4:junit4]   2> 2639 T408 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@429664
[junit4:junit4]   2> 2639 T408 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355301186831/jetty1/index/
[junit4:junit4]   2> 2639 T408 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355301186831/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 2640 T408 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355301186831/jetty1/index forceNew:false
[junit4:junit4]   2> 2643 T408 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355301186831/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@754c59; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 2643 T408 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 2644 T408 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 2645 T408 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 2645 T408 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 2646 T408 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 2646 T408 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 2646 T408 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 2647 T408 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 2647 T408 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 2648 T408 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 2648 T408 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 2649 T408 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 2650 T408 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 2650 T408 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 2651 T408 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 2651 T408 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 2652 T408 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 2652 T408 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 2653 T408 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2654 T408 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2655 T408 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2655 T408 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2656 T408 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2657 T408 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2658 T408 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2659 T408 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 2659 T408 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 2661 T408 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 2663 T408 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 2664 T408 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 2666 T408 oass.SolrIndexSearcher.<init> Opening Searcher@edd93c main
[junit4:junit4]   2> 2666 T408 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 2667 T408 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 2667 T408 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 2667 T408 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 2670 T408 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 2695 T409 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@edd93c main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 2700 T408 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 2700 T408 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 3098 T391 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3099 T391 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:33920_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:33920/solr"}
[junit4:junit4]   2> 3099 T391 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4]   2> 3101 T391 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 3107 T390 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3107 T407 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3202 T408 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 3202 T408 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:33920/solr shardId:shard1
[junit4:junit4]   2> 3203 T408 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 3212 T373 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e3eed510005 type:delete cxid:0x45 zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 3213 T408 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 3214 T373 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e3eed510005 type:create cxid:0x46 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3216 T408 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 3216 T408 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 3217 T408 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:33920/solr/collection1/
[junit4:junit4]   2> 3217 T408 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 3217 T408 oasc.SyncStrategy.syncToMe http://127.0.0.1:33920/solr/collection1/ has no replicas
[junit4:junit4]   2> 3217 T408 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:33920/solr/collection1/
[junit4:junit4]   2> 3217 T408 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 3222 T373 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e3eed510005 type:create cxid:0x50 zxid:0x60 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3612 T391 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3627 T390 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3627 T407 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3675 T408 oasc.ZkController.register We are http://127.0.0.1:33920/solr/collection1/ and leader is http://127.0.0.1:33920/solr/collection1/
[junit4:junit4]   2> 3675 T408 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:33920/solr
[junit4:junit4]   2> 3675 T408 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 3675 T408 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 3675 T408 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 3677 T408 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3678 T368 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 3679 T368 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 3679 T368 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 3727 T368 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 3729 T368 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:58474
[junit4:junit4]   2> 3729 T368 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 3730 T368 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355301190510
[junit4:junit4]   2> 3730 T368 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355301190510/'
[junit4:junit4]   2> 3741 T368 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 3741 T368 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 3741 T368 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355301190510
[junit4:junit4]   2> 3742 T368 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355301190510/solr.xml
[junit4:junit4]   2> 3742 T368 oasc.CoreContainer.<init> New CoreContainer 10575880
[junit4:junit4]   2> 3742 T368 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355301190510/'
[junit4:junit4]   2> 3743 T368 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355301190510/'
[junit4:junit4]   2> 3754 T368 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 3762 T368 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:55023/solr
[junit4:junit4]   2> 3762 T368 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 3762 T368 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:55023 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@a25f4a
[junit4:junit4]   2> 3763 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3763 T419 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:55023. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 3764 T419 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:55023, initiating session
[junit4:junit4]   2> 3764 T370 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:42364
[junit4:junit4]   2> 3764 T370 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:42364
[junit4:junit4]   2> 3765 T372 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8e3eed510006 with negotiated timeout 20000 for client /127.0.0.1:42364
[junit4:junit4]   2> 3765 T419 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:55023, sessionid = 0x13b8e3eed510006, negotiated timeout = 20000
[junit4:junit4]   2> 3765 T420 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a25f4a name:ZooKeeperConnection Watcher:127.0.0.1:55023 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3766 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3767 T373 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8e3eed510006
[junit4:junit4]   2> 3767 T420 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 3767 T370 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:42364 which had sessionid 0x13b8e3eed510006
[junit4:junit4]   2> 3767 T368 oaz.ZooKeeper.close Session: 0x13b8e3eed510006 closed
[junit4:junit4]   2> 3768 T368 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:55023/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@116cad6
[junit4:junit4]   2> 3769 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3769 T421 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:55023. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 3769 T421 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:55023, initiating session
[junit4:junit4]   2> 3769 T370 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:42365
[junit4:junit4]   2> 3770 T370 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:42365
[junit4:junit4]   2> 3770 T372 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8e3eed510007 with negotiated timeout 8000 for client /127.0.0.1:42365
[junit4:junit4]   2> 3770 T421 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:55023, sessionid = 0x13b8e3eed510007, negotiated timeout = 8000
[junit4:junit4]   2> 3771 T422 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@116cad6 name:ZooKeeperConnection Watcher:127.0.0.1:55023/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3771 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3772 T373 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e3eed510007 type:create cxid:0x1 zxid:0x6d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3772 T373 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e3eed510007 type:create cxid:0x2 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3773 T368 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58474_solr
[junit4:junit4]   2> 3774 T373 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e3eed510007 type:delete cxid:0x4 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:58474_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:58474_solr
[junit4:junit4]   2> 3775 T368 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:58474_solr
[junit4:junit4]   2> 3777 T407 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3777 T390 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 3777 T390 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 3778 T368 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 3779 T407 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 3779 T368 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 3779 T368 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 3779 T368 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 3780 T368 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 3780 T368 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 3780 T368 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 3781 T368 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 3781 T368 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 3781 T368 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 3788 T368 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3793 T423 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355301190510/collection1
[junit4:junit4]   2> 3793 T423 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 3794 T423 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 3794 T423 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 3795 T423 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355301190510/collection1/'
[junit4:junit4]   2> 3796 T423 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty2-1355301190510/collection1/lib/README' to classloader
[junit4:junit4]   2> 3796 T423 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty2-1355301190510/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 3831 T423 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 3871 T423 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 3873 T423 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 3876 T423 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 4134 T391 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4135 T391 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:33920_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:33920/solr"}
[junit4:junit4]   2> 4139 T422 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4139 T407 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4139 T390 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4201 T423 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 4206 T423 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 4208 T423 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 4223 T423 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 4226 T423 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 4229 T423 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 4230 T423 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 4231 T423 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355301190510/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355301186831/jetty2/
[junit4:junit4]   2> 4232 T423 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@429664
[junit4:junit4]   2> 4232 T423 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355301186831/jetty2/index/
[junit4:junit4]   2> 4232 T423 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355301186831/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 4233 T423 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355301186831/jetty2/index forceNew:false
[junit4:junit4]   2> 4236 T423 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355301186831/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1edccf7; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 4236 T423 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 4236 T423 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 4238 T423 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 4238 T423 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 4238 T423 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 4239 T423 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 4239 T423 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 4239 T423 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 4239 T423 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 4240 T423 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 4241 T423 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 4242 T423 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 4242 T423 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 4243 T423 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 4244 T423 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 4244 T423 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 4244 T423 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 4245 T423 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 4245 T423 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4246 T423 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4247 T423 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4248 T423 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4248 T423 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4249 T423 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4250 T423 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4251 T423 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 4251 T423 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 4254 T423 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 4255 T423 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 4257 T423 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 4258 T423 oass.SolrIndexSearcher.<init> Opening Searcher@108c21a main
[junit4:junit4]   2> 4258 T423 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 4259 T423 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 4259 T423 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 4260 T423 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 4262 T423 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 4284 T424 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@108c21a main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 4291 T423 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 4291 T423 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 4645 T391 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4647 T391 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:58474_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:58474/solr"}
[junit4:junit4]   2> 4647 T391 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 4647 T391 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4]   2> 4651 T390 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4651 T422 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4651 T407 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4793 T423 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 4793 T423 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:58474/solr shardId:shard2
[junit4:junit4]   2> 4794 T423 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4]   2> 4800 T373 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e3eed510007 type:delete cxid:0x44 zxid:0x7e txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard2 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard2
[junit4:junit4]   2> 4801 T423 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 4801 T373 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e3eed510007 type:create cxid:0x45 zxid:0x7f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4803 T423 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 4803 T423 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 4803 T423 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:58474/solr/collection1/
[junit4:junit4]   2> 4804 T423 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 4804 T423 oasc.SyncStrategy.syncToMe http://127.0.0.1:58474/solr/collection1/ has no replicas
[junit4:junit4]   2> 4804 T423 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:58474/solr/collection1/
[junit4:junit4]   2> 4804 T423 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4]   2> 4808 T373 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e3eed510007 type:create cxid:0x4e zxid:0x82 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5156 T391 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5165 T407 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5169 T390 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5164 T422 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5210 T423 oasc.ZkController.register We are http://127.0.0.1:58474/solr/collection1/ and leader is http://127.0.0.1:58474/solr/collection1/
[junit4:junit4]   2> 5210 T423 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:58474/solr
[junit4:junit4]   2> 5210 T423 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 5211 T423 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 5211 T423 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 5212 T423 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5213 T368 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 5214 T368 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 5214 T368 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 5262 T368 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 5264 T368 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:55873
[junit4:junit4]   2> 5265 T368 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 5265 T368 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355301192045
[junit4:junit4]   2> 5266 T368 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355301192045/'
[junit4:junit4]   2> 5276 T368 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 5277 T368 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 5277 T368 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355301192045
[junit4:junit4]   2> 5277 T368 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355301192045/solr.xml
[junit4:junit4]   2> 5278 T368 oasc.CoreContainer.<init> New CoreContainer 25175277
[junit4:junit4]   2> 5278 T368 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355301192045/'
[junit4:junit4]   2> 5278 T368 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355301192045/'
[junit4:junit4]   2> 5290 T368 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 5297 T368 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:55023/solr
[junit4:junit4]   2> 5297 T368 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 5298 T368 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:55023 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@159ac41
[junit4:junit4]   2> 5298 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 5299 T434 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:55023. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 5299 T434 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:55023, initiating session
[junit4:junit4]   2> 5299 T370 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:42366
[junit4:junit4]   2> 5300 T370 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:42366
[junit4:junit4]   2> 5301 T372 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8e3eed510008 with negotiated timeout 20000 for client /127.0.0.1:42366
[junit4:junit4]   2> 5301 T434 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:55023, sessionid = 0x13b8e3eed510008, negotiated timeout = 20000
[junit4:junit4]   2> 5301 T435 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@159ac41 name:ZooKeeperConnection Watcher:127.0.0.1:55023 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 5301 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 5303 T373 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8e3eed510008
[junit4:junit4]   2> 5303 T370 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:42366 which had sessionid 0x13b8e3eed510008
[junit4:junit4]   2> 5303 T435 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 5303 T368 oaz.ZooKeeper.close Session: 0x13b8e3eed510008 closed
[junit4:junit4]   2> 5304 T368 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:55023/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@7271
[junit4:junit4]   2> 5305 T436 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:55023. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 5305 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 5305 T436 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:55023, initiating session
[junit4:junit4]   2> 5305 T370 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:42367
[junit4:junit4]   2> 5306 T370 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:42367
[junit4:junit4]   2> 5306 T372 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8e3eed510009 with negotiated timeout 8000 for client /127.0.0.1:42367
[junit4:junit4]   2> 5306 T436 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:55023, sessionid = 0x13b8e3eed510009, negotiated timeout = 8000
[junit4:junit4]   2> 5307 T437 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7271 name:ZooKeeperConnection Watcher:127.0.0.1:55023/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 5307 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 5308 T373 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e3eed510009 type:create cxid:0x1 zxid:0x8f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5309 T373 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e3eed510009 type:create cxid:0x2 zxid:0x90 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5309 T368 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55873_solr
[junit4:junit4]   2> 5310 T373 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e3eed510009 type:delete cxid:0x4 zxid:0x91 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:55873_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:55873_solr
[junit4:junit4]   2> 5311 T368 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55873_solr
[junit4:junit4]   2> 5313 T422 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5313 T407 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5313 T390 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 5313 T390 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5315 T422 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 5315 T407 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 5315 T368 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 5315 T368 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 5316 T368 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 5316 T368 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 5316 T368 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 5317 T368 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 5317 T368 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 5317 T368 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 5318 T368 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 5318 T368 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 5325 T368 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 5330 T438 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355301192045/collection1
[junit4:junit4]   2> 5330 T438 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 5331 T438 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 5331 T438 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 5332 T438 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355301192045/collection1/'
[junit4:junit4]   2> 5333 T438 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty3-1355301192045/collection1/lib/README' to classloader
[junit4:junit4]   2> 5333 T438 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty3-1355301192045/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 5364 T438 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 5405 T438 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 5407 T438 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 5411 T438 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 5677 T391 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5678 T391 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:58474_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:58474/solr"}
[junit4:junit4]   2> 5686 T407 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5686 T422 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5686 T390 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5686 T437 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5731 T438 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 5736 T438 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 5738 T438 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 5752 T438 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5755 T438 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5758 T438 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5759 T438 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5760 T438 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355301192045/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355301186831/jetty3/
[junit4:junit4]   2> 5761 T438 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@429664
[junit4:junit4]   2> 5761 T438 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355301186831/jetty3/index/
[junit4:junit4]   2> 5761 T438 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355301186831/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 5762 T438 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355301186831/jetty3/index forceNew:false
[junit4:junit4]   2> 5765 T438 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355301186831/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@158dde9; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 5765 T438 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 5766 T438 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 5767 T438 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 5767 T438 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 5768 T438 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 5768 T438 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 5768 T438 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 5768 T438 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 5769 T438 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 5769 T438 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 5770 T438 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 5771 T438 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 5772 T438 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 5772 T438 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 5773 T438 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 5773 T438 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 5773 T438 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 5774 T438 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 5775 T438 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5775 T438 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5776 T438 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5777 T438 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5778 T438 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5778 T438 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5779 T438 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5780 T438 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 5781 T438 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 5783 T438 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 5784 T438 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 5786 T438 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 5787 T438 oass.SolrIndexSearcher.<init> Opening Searcher@e71b55 main
[junit4:junit4]   2> 5787 T438 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 5788 T438 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 5788 T438 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 5789 T438 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 5792 T438 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 5813 T439 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@e71b55 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 5817 T438 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 5818 T438 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 6192 T391 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6193 T391 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:55873_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:55873/solr"}
[junit4:junit4]   2> 6193 T391 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 6194 T391 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 6197 T390 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6197 T422 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6198 T437 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6198 T407 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6319 T438 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 6319 T438 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:55873/solr shardId:shard1
[junit4:junit4]   2> 6323 T438 oasc.ZkController.register We are http://127.0.0.1:55873/solr/collection1/ and leader is http://127.0.0.1:33920/solr/collection1/
[junit4:junit4]   2> 6323 T438 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:55873/solr
[junit4:junit4]   2> 6323 T438 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 6323 T438 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C29 name=collection1 org.apache.solr.core.SolrCore@54970e url=http://127.0.0.1:55873/solr/collection1 node=127.0.0.1:55873_solr
[junit4:junit4]   2> 6326 T440 C29 P55873 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 6326 T438 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6327 T440 C29 P55873 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 6327 T440 C29 P55873 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 6327 T440 C29 P55873 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 6327 T368 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 6333 T368 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 6333 T440 C29 P55873 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:33920/solr/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 6333 T368 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 6336 T440 C29 P55873 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4]   2> 6340 T440 C29 P55873 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:55873/solr START replicas=[http://127.0.0.1:33920/solr/collection1/] nUpdates=100
[junit4:junit4]   2> 6341 T440 C29 P55873 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 6341 T440 C29 P55873 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 6341 T440 C29 P55873 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 6341 T440 C29 P55873 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C30 name=collection1 org.apache.solr.core.SolrCore@15b1a7b url=http://127.0.0.1:33920/solr/collection1 node=127.0.0.1:33920_solr
[junit4:junit4]   2> 6347 T402 C30 P33920 REQ /get {distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=0 
[junit4:junit4]   2> 6400 T368 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 6402 T368 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:42593
[junit4:junit4]   2> 6402 T368 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 6403 T368 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355301193166
[junit4:junit4]   2> 6403 T368 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355301193166/'
[junit4:junit4]   2> 6418 T368 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 6419 T368 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 6419 T368 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355301193166
[junit4:junit4]   2> 6419 T368 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355301193166/solr.xml
[junit4:junit4]   2> 6420 T368 oasc.CoreContainer.<init> New CoreContainer 2934298
[junit4:junit4]   2> 6420 T368 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355301193166/'
[junit4:junit4]   2> 6421 T368 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355301193166/'
[junit4:junit4]   2> 6436 T368 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 6445 T368 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:55023/solr
[junit4:junit4]   2> 6445 T368 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 6446 T368 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:55023 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@2a86a
[junit4:junit4]   2> 6446 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6447 T451 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:55023. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 6447 T451 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:55023, initiating session
[junit4:junit4]   2> 6447 T370 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:42372
[junit4:junit4]   2> 6448 T370 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:42372
[junit4:junit4]   2> 6449 T372 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8e3eed51000a with negotiated timeout 20000 for client /127.0.0.1:42372
[junit4:junit4]   2> 6449 T451 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:55023, sessionid = 0x13b8e3eed51000a, negotiated timeout = 20000
[junit4:junit4]   2> 6449 T452 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2a86a name:ZooKeeperConnection Watcher:127.0.0.1:55023 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6449 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6451 T373 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8e3eed51000a
[junit4:junit4]   2> 6451 T370 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:42372 which had sessionid 0x13b8e3eed51000a
[junit4:junit4]   2> 6451 T368 oaz.ZooKeeper.close Session: 0x13b8e3eed51000a closed
[junit4:junit4]   2> 6451 T452 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 6452 T368 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:55023/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@ee3105
[junit4:junit4]   2> 6452 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6453 T453 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:55023. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 6453 T453 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:55023, initiating session
[junit4:junit4]   2> 6453 T370 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:42373
[junit4:junit4]   2> 6453 T370 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:42373
[junit4:junit4]   2> 6455 T372 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8e3eed51000b with negotiated timeout 8000 for client /127.0.0.1:42373
[junit4:junit4]   2> 6455 T453 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:55023, sessionid = 0x13b8e3eed51000b, negotiated timeout = 8000
[junit4:junit4]   2> 6455 T454 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ee3105 name:ZooKeeperConnection Watcher:127.0.0.1:55023/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6455 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6456 T373 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e3eed51000b type:create cxid:0x1 zxid:0xa2 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6457 T373 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e3eed51000b type:create cxid:0x2 zxid:0xa3 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6458 T368 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42593_solr
[junit4:junit4]   2> 6458 T373 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8e3eed51000b type:delete cxid:0x4 zxid:0xa4 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:42593_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:42593_solr
[junit4:junit4]   2> 6459 T368 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:42593_solr
[junit4:junit4]   2> 6461 T422 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6461 T407 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6461 T437 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6462 T390 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 6462 T390 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6463 T422 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 6463 T437 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 6463 T407 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 6463 T368 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 6464 T368 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 6464 T368 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 6465 T368 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 6465 T368 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 6466 T368 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 6466 T368 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 6467 T368 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 6467 T368 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 6468 T368 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 6482 T368 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 6490 T455 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355301193166/collection1
[junit4:junit4]   2> 6490 T455 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 6491 T455 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 6492 T455 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 6494 T455 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355301193166/collection1/'
[junit4:junit4]   2> 6494 T455 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty4-1355301193166/collection1/lib/README' to classloader
[junit4:junit4]   2> 6495 T455 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty4-1355301193166/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 6530 T455 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 6586 T455 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 6587 T455 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 6593 T455 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 6703 T391 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6704 T391 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:55873_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:55873/solr"}
[junit4:junit4]   2> 6709 T390 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6709 T454 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6710 T422 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6710 T407 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6710 T437 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6948 T455 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 6953 T455 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 6956 T455 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 6970 T455 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 6973 T455 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 6976 T455 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 6977 T455 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 6978 T455 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355301193166/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355301186831/jetty4/
[junit4:junit4]   2> 6978 T455 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@429664
[junit4:junit4]   2> 6979 T455 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355301186831/jetty4/index/
[junit4:junit4]   2> 6979 T455 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355301186831/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 6979 T455 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355301186831/jetty4/index forceNew:false
[junit4:junit4]   2> 6982 T455 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355301186831/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@774e54; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 6983 T455 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 6983 T455 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 6984 T455 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 6985 T455 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 6985 T455 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 6985 T455 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 6985 T455 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 6986 T455 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 6986 T455 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 6987 T455 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 6987 T455 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 6988 T455 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 6989 T455 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 6989 T455 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 6990 T455 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 6990 T455 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 6990 T455 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 6991 T455 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 6992 T455 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6993 T455 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6993 T455 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6994 T455 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6995 T455 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6996 T455 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6996 T455 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6997 T455 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 6998 T455 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 7000 T455 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 7001 T455 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 7003 T455 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 7004 T455 oass.SolrIndexSearcher.<init> Opening Searcher@1afbf53 main
[junit4:junit4]   2> 7005 T455 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 7005 T455 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 7005 T455 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 7006 T455 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 7009 T455 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 7029 T456 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1afbf53 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 7038 T455 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 7039 T455 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 7216 T391 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7217 T391 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:42593_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:42593/solr"}
[junit4:junit4]   2> 7217 T391 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 7217 T391 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4]   2> 7221 T390 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7221 T422 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7221 T407 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7221 T437 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7221 T454 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7540 T455 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 7540 T455 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:42593/solr shardId:shard2
[junit4:junit4]   2> 7544 T455 oasc.ZkController.register We are http://127.0.0.1:42593/solr/collection1/ and leader is http://127.0.0.1:58474/solr/collection1/
[junit4:junit4]   2> 7544 T455 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:42593/solr
[junit4:junit4]   2> 7544 T455 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 7544 T455 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C31 name=collection1 org.apache.solr.core.SolrCore@1b4ab2b url=http://127.0.0.1:42593/solr/collection1 node=127.0.0.1:42593_solr
[junit4:junit4]   2> 7545 T457 C31 P42593 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 7545 T457 C31 P42593 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 7545 T457 C31 P42593 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 7545 T455 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7546 T457 C31 P42593 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 7547 T368 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 7547 T457 C31 P42593 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:58474/solr/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 7547 T368 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 7547 T457 C31 P42593 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:42593/solr START replicas=[http://127.0.0.1:58474/solr/collection1/] nUpdates=100
[junit4:junit4]   2> 7547 T368 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 7547 T457 C31 P42593 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 7548 T457 C31 P42593 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 7548 T457 C31 P42593 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 7548 T457 C31 P42593 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 7553 T368 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:55023/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1185382
[junit4:junit4]   2> ASYNC  NEW_CORE C32 name=collection1 org.apache.solr.core.SolrCore@87a5b3 url=http://127.0.0.1:58474/solr/collection1 node=127.0.0.1:58474_solr
[junit4:junit4]   2> 7553 T418 C32 P58474 REQ /get {distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=0 
[junit4:junit4]   2> 7554 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 7554 T459 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:55023. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 7554 T459 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:55023, initiating session
[junit4:junit4]   2> 7554 T370 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:42376
[junit4:junit4]   2> 7555 T370 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:42376
[junit4:junit4]   2> 7555 T372 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8e3eed51000c with negotiated timeout 10000 for client /127.0.0.1:42376
[junit4:junit4]   2> 7555 T459 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:55023, sessionid = 0x13b8e3eed51000c, negotiated timeout = 10000
[junit4:junit4]   2> 7556 T460 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1185382 name:ZooKeeperConnection Watcher:127.0.0.1:55023/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 7556 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 7557 T368 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 7560 T368 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 7561 T368 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 7564 T368 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7565 T368 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):540
[junit4:junit4]   2> 7566 T368 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7727 T391 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7728 T391 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:42593_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:42593/solr"}
[junit4:junit4]   2> 7732 T390 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7732 T454 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7732 T422 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7732 T460 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7733 T407 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7733 T437 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8568 T368 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2>  C29_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:55873_solr, base_url=http://127.0.0.1:55873/solr}
[junit4:junit4]   2> 9351 T440 C29 P55873 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 9352 T440 C29 P55873 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 9352 T440 C29 P55873 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:33920/solr/collection1/. core=collection1
[junit4:junit4]   2> 9352 T440 C29 P55873 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 9356 T400 C30 P33920 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 9358 T400 C30 P33920 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355301186831/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@754c59; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 9358 T400 C30 P33920 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 9408 T400 C30 P33920 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355301186831/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@754c59; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355301186831/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@754c59; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 9409 T400 C30 P33920 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 9409 T400 C30 P33920 oass.SolrIndexSearcher.<init> Opening Searcher@1b9b89f realtime
[junit4:junit4]   2> 9409 T400 C30 P33920 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 9410 T400 C30 P33920 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 9410 T400 C30 P33920 /update {waitSearcher=true&openSearcher=false&commit=true&commit_end_point=true&wt=javabin&softCommit=false&version=2} {commit=} 0 54
[junit4:junit4]   2> 9424 T440 C29 P55873 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 9425 T440 C29 P55873 oascsi.HttpClientUtil.createClient Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
[junit4:junit4]   2> 9431 T440 C29 P55873 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 9434 T401 C30 P33920 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 9434 T401 C30 P33920 REQ /replication {command=indexversion&wt=javabin&qt=/replication&version=2} status=0 QTime=2 
[junit4:junit4]   2> 9435 T440 C29 P55873 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 9435 T440 C29 P55873 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 9435 T440 C29 P55873 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 9438 T400 C30 P33920 REQ /replication {command=filelist&generation=2&wt=javabin&qt=/replication&version=2} status=0 QTime=1 
[junit4:junit4]   2> 9438 T440 C29 P55873 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 9439 T440 C29 P55873 oash.SnapPuller.fetchLatestIndex Starting download to ./org.apache.solr.cloud.BasicDistributedZkTest-1355301186831/jetty3/index.20121212180316267 fullCopy=true
[junit4:junit4]   2> 9444 T403 C30 P33920 REQ /replication {file=segments_2&command=filecontent&checksum=true&generation=2&qt=/replication&wt=filestream} status=0 QTime=1 
[junit4:junit4]   2> 9449 T440 C29 P55873 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 9458 T440 C29 P55873 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20121212180316267
[junit4:junit4]   2> 9459 T440 C29 P55873 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.BasicDistributedZkTest-1355301186831/jetty3/index/ new=./org.apache.solr.cloud.BasicDistributedZkTest-1355301186831/jetty3/index.20121212180316267
[junit4:junit4]   2> 9460 T440 C29 P55873 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355301186831/jetty3/index.20121212180316267 forceNew:false
[junit4:junit4]   2> 9461 T440 C29 P55873 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355301186831/jetty3/index.20121212180316267 lockFactory=org.apache.lucene.store.NativeFSLockFactory@d9679e; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 9462 T440 C29 P55873 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 9463 T440 C29 P55873 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 9463 T440 C29 P55873 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 9464 T440 C29 P55873 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4]   2> 9464 T440 C29 P55873 oasc.CachingDirectoryFactory.close Closing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355301186831/jetty3/index.20121212180316267
[junit4:junit4]   2> 9465 T440 C29 P55873 oash.SnapPuller$2.onClose removing old index directory ./org.apache.solr.cloud.BasicDistributedZkTest-1355301186831/jetty3/index
[junit4:junit4]   2> 9465 T440 C29 P55873 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355301186831/jetty3/index.20121212180316267 forceNew:true
[junit4:junit4]   2> 9467 T440 C29 P55873 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355301186831/jetty3/index.20121212180316267 lockFactory=org.apache.lucene.store.NativeFSLockFactory@a6f04d; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 9467 T440 C29 P55873 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 9467 T440 C29 P55873 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 9468 T440 C29 P55873 oass.SolrIndexSearcher.<init> Opening Searcher@193eb44 main
[junit4:junit4]   2> 9468 T440 C29 P55873 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 9470 T439 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@193eb44 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 9470 T440 C29 P55873 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 9500 T440 C29 P55873 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355301186831/jetty3/index.20121212180316267 lockFactory=org.apache.lucene.store.NativeFSLockFactory@a6f04d; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355301186831/jetty3/index.20121212180316267 lockFactory=org.apache.lucene.store.NativeFSLockFactory@a6f04d; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 9501 T440 C29 P55873 oasc.SolrDeletionPolicy.updateCommits newest commit = 3
[junit4:junit4]   2> 9501 T440 C29 P55873 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 9501 T440 C29 P55873 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 9502 T440 C29 P55873 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 9502 T440 C29 P55873 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 9502 T440 C29 P55873 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 9503 T440 C29 P55873 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 9570 T368 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9745 T391 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9746 T391 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:55873_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:55873/solr"}
[junit4:junit4]   2> 9759 T390 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9759 T460 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9759 T407 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9759 T437 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9759 T422 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9759 T454 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2>  C31_STATE=coll:collection1 core:collection1 props:{shard=shard2, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:42593_solr, base_url=http://127.0.0.1:42593/solr}
[junit4:junit4]   2> 10553 T457 C31 P42593 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 10553 T457 C31 P42593 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 10553 T457 C31 P42593 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:58474/solr/collection1/. core=collection1
[junit4:junit4]   2> 10554 T457 C31 P42593 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 10558 T415 C32 P58474 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 10560 T415 C32 P58474 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355301186831/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1edccf7; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 10561 T415 C32 P58474 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 10568 T415 C32 P58474 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355301186831/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1edccf7; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355301186831/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1edccf7; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 10569 T415 C32 P58474 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 10569 T415 C32 P58474 oass.SolrIndexSearcher.<init> Opening Searcher@ac8862 realtime
[junit4:junit4]   2> 10570 T415 C32 P58474 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 10570 T415 C32 P58474 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 10570 T415 C32 P58474 /update {waitSearcher=true&openSearcher=false&commit=true&commit_end_point=true&wt=javabin&softCommit=false&version=2} {commit=} 0 12
[junit4:junit4]   2> 10571 T457 C31 P42593 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 10572 T457 C31 P42593 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 10572 T368 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10575 T417 C32 P58474 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 10575 T417 C32 P58474 REQ /replication {command=indexversion&wt=javabin&qt=/replication&version=2} status=0 QTime=2 
[junit4:junit4]   2> 10576 T457 C31 P42593 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 10576 T457 C31 P42593 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 10576 T457 C31 P42593 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 10578 T415 C32 P58474 REQ /replication {command=filelist&generation=2&wt=javabin&qt=/replication&version=2} status=0 QTime=0 
[junit4:junit4]   2> 10579 T457 C31 P42593 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 10579 T457 C31 P42593 oash.SnapPuller.fetchLatestIndex Starting download to ./org.apache.solr.cloud.BasicDistributedZkTest-1355301186831/jetty4/index.20121212180317407 fullCopy=true
[junit4:junit4]   2> 10582 T416 C32 P58474 REQ /replication {file=segments_2&command=filecontent&checksum=true&generation=2&qt=/replication&wt=filestream} status=0 QTime=1 
[junit4:junit4]   2> 10584 T457 C31 P42593 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 10588 T457 C31 P42593 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20121212180317407
[junit4:junit4]   2> 10589 T457 C31 P42593 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.BasicDistributedZkTest-1355301186831/jetty4/index/ new=./org.apache.solr.cloud.BasicDistributedZkTest-1355301186831/jetty4/index.20121212180317407
[junit4:junit4]   2> 10589 T457 C31 P42593 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355301186831/jetty4/index.20121212180317407 forceNew:false
[junit4:junit4]   2> 10591 T457 C31 P42593 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355301186831/jetty4/index.20121212180317407 lockFactory=org.apache.lucene.store.NativeFSLockFactory@367fb6; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 10598 T457 C31 P42593 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 10599 T457 C31 P42593 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 10599 T457 C31 P42593 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 10599 T457 C31 P42593 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4]   2> 10600 T457 C31 P42593 oasc.CachingDirectoryFactory.close Closing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355301186831/jetty4/index.20121212180317407
[junit4:junit4]   2> 10600 T457 C31 P42593 oash.SnapPuller$2.onClose removing old index directory ./org.apache.solr.cloud.BasicDistributedZkTest-1355301186831/jetty4/index
[junit4:junit4]   2> 10601 T457 C31 P42593 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355301186831/jetty4/index.20121212180317407 forceNew:true
[junit4:junit4]   2> 10602 T457 C31 P42593 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355301186831/jetty4/index.20121212180317407 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4092c6; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 10602 T457 C31 P42593 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 10602 T457 C31 P42593 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 10602 T457 C31 P42593 oass.SolrIndexSearcher.<init> Opening Searcher@16ef544 main
[junit4:junit4]   2> 10603 T457 C31 P42593 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 10604 T456 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@16ef544 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 10604 T457 C31 P42593 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 10630 T457 C31 P42593 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355301186831/jetty4/index.20121212180317407 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4092c6; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355301186831/jetty4/index.20121212180317407 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4092c6; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 10630 T457 C31 P42593 oasc.SolrDeletionPolicy.updateCommits newest commit = 3
[junit4:junit4]   2> 10631 T457 C31 P42593 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 10631 T457 C31 P42593 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 10631 T457 C31 P42593 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 10631 T457 C31 P42593 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 10631 T457 C31 P42593 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 10632 T457 C31 P42593 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 10768 T391 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10769 T391 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[jun

[...truncated too long message...]

.0.0.1:52871/solr"},
[junit4:junit4]   1>               "127.0.0.1:52353_solr_collection1":{
[junit4:junit4]   1>                 "shard":"shard1",
[junit4:junit4]   1>                 "roles":null,
[junit4:junit4]   1>                 "state":"active",
[junit4:junit4]   1>                 "core":"collection1",
[junit4:junit4]   1>                 "collection":"collection1",
[junit4:junit4]   1>                 "node_name":"127.0.0.1:52353_solr",
[junit4:junit4]   1>                 "base_url":"http://127.0.0.1:52353/solr",
[junit4:junit4]   1>                 "leader":"true"},
[junit4:junit4]   1>               "127.0.0.1:38078_solr_collection1":{
[junit4:junit4]   1>                 "shard":"shard1",
[junit4:junit4]   1>                 "roles":null,
[junit4:junit4]   1>                 "state":"active",
[junit4:junit4]   1>                 "core":"collection1",
[junit4:junit4]   1>                 "collection":"collection1",
[junit4:junit4]   1>                 "node_name":"127.0.0.1:38078_solr",
[junit4:junit4]   1>                 "base_url":"http://127.0.0.1:38078/solr"}}}},
[junit4:junit4]   1>         "control_collection":{"control_shard":{"replicas":{"127.0.0.1:33259_solr_collection1":{
[junit4:junit4]   1>                 "shard":"control_shard",
[junit4:junit4]   1>                 "roles":null,
[junit4:junit4]   1>                 "state":"active",
[junit4:junit4]   1>                 "core":"collection1",
[junit4:junit4]   1>                 "collection":"control_collection",
[junit4:junit4]   1>                 "node_name":"127.0.0.1:33259_solr",
[junit4:junit4]   1>                 "base_url":"http://127.0.0.1:33259/solr",
[junit4:junit4]   1>                 "leader":"true"}}}}}
[junit4:junit4]   1>  /zookeeper (1)
[junit4:junit4]   1>  DATA:
[junit4:junit4]   1>      
[junit4:junit4]   1> 
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=SyncSliceTest -Dtests.method=testDistribSearch -Dtests.seed=9625D754350C60BE -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=iw_IL -Dtests.timezone=America/Jamaica -Dtests.file.encoding=UTF-8
[junit4:junit4] FAILURE  582s J1 | SyncSliceTest.testDistribSearch <<<
[junit4:junit4]    > Throwable #1: java.lang.AssertionError: There are still nodes recoverying - waited for 540 seconds
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([9625D754350C60BE:17C3594C42530082]:0)
[junit4:junit4]    > 	at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:165)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:115)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:110)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:563)
[junit4:junit4]    > 	at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:224)
[junit4:junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:601)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 582199 T252 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> NOTE: test params are: codec=Lucene3x, sim=RandomSimilarityProvider(queryNorm=true,coord=yes): {}, locale=iw_IL, timezone=America/Jamaica
[junit4:junit4]   2> NOTE: Linux 3.2.0-34-generic i386/Oracle Corporation 1.7.0_09 (32-bit)/cpus=8,threads=1,free=15662576,total=65536000
[junit4:junit4]   2> NOTE: All tests run in this JVM: [TestDFRSimilarityFactory, TestArbitraryIndexDir, TestReversedWildcardFilterFactory, ShowFileRequestHandlerTest, RAMDirectoryFactoryTest, DocumentAnalysisRequestHandlerTest, SolrIndexConfigTest, BasicDistributedZk2Test, TestSurroundQueryParser, LegacyHTMLStripCharFilterTest, TestPropInjectDefaults, TestStressLucene, DisMaxRequestHandlerTest, TestHashPartitioner, FileUtilsTest, TestPluginEnable, SyncSliceTest]
[junit4:junit4] Completed on J1 in 582.22s, 1 test, 1 failure <<< FAILURES!

[...truncated 141 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:352: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:178: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:438: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1171: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:835: There were test failures: 239 suites, 994 tests, 1 error, 2 failures, 8 ignored (3 assumptions)

Total time: 40 minutes 17 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 32bit/jdk1.7.0_09 -server -XX:+UseSerialGC
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-4.x-Linux (32bit/ibm-j9-jdk6) - Build # 3178 - Still Failing!

Posted by Policeman Jenkins Server <je...@sd-datasolutions.de>.
Build: http://jenkins.sd-datasolutions.de/job/Lucene-Solr-4.x-Linux/3178/
Java: 32bit/ibm-j9-jdk6 

3 tests failed.
FAILED:  org.apache.solr.cloud.SyncSliceTest.testDistribSearch

Error Message:
There are still nodes recoverying - waited for 540 seconds

Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 540 seconds
	at __randomizedtesting.SeedInfo.seed([1D016F7364EF4507:9CE7E16B13B0253B]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:165)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:115)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:110)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:563)
	at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:224)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:60)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:37)
	at java.lang.reflect.Method.invoke(Method.java:611)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:738)


FAILED:  org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch

Error Message:
There are still nodes recoverying - waited for 540 seconds

Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 540 seconds
	at __randomizedtesting.SeedInfo.seed([1D016F7364EF4507:9CE7E16B13B0253B]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:165)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:115)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:110)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:563)
	at org.apache.solr.cloud.BasicDistributedZk2Test.brindDownShardIndexSomeDocsAndRecover(BasicDistributedZk2Test.java:321)
	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:83)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:60)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:37)
	at java.lang.reflect.Method.invoke(Method.java:611)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:738)


FAILED:  org.apache.solr.cloud.BasicDistributedZkTest.testDistribSearch

Error Message:
Server at http://127.0.0.1:38973/solr returned non ok status:500, message:Server Error

Stack Trace:
org.apache.solr.common.SolrException: Server at http://127.0.0.1:38973/solr returned non ok status:500, message:Server Error
	at __randomizedtesting.SeedInfo.seed([1D016F7364EF4507:9CE7E16B13B0253B]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:372)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
	at org.apache.solr.client.solrj.request.CoreAdminRequest.process(CoreAdminRequest.java:429)
	at org.apache.solr.client.solrj.request.CoreAdminRequest.getStatus(CoreAdminRequest.java:472)
	at org.apache.solr.cloud.BasicDistributedZkTest.collectStartTimes(BasicDistributedZkTest.java:959)
	at org.apache.solr.cloud.BasicDistributedZkTest.testCollectionsAPI(BasicDistributedZkTest.java:795)
	at org.apache.solr.cloud.BasicDistributedZkTest.doTest(BasicDistributedZkTest.java:343)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:60)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:37)
	at java.lang.reflect.Method.invoke(Method.java:611)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:738)




Build Log:
[...truncated 8084 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZk2Test
[junit4:junit4]   2> 5 T165 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1355296550414
[junit4:junit4]   2> 9 T165 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 11 T166 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 25 T166 oaz.Environment.logEnv Server environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
[junit4:junit4]   2> 26 T166 oaz.Environment.logEnv Server environment:host.name=serv1
[junit4:junit4]   2> 26 T166 oaz.Environment.logEnv Server environment:java.version=1.6.0
[junit4:junit4]   2> 27 T166 oaz.Environment.logEnv Server environment:java.vendor=IBM Corporation
[junit4:junit4]   2> 27 T166 oaz.Environment.logEnv Server environment:java.home=/opt/ibm/java-i386-60/jre
[junit4:junit4]   2> 28 T166 oaz.Environment.logEnv Server environment:java.class.path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/test:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/codecs/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-solrj/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/common/lucene-analyzers-common-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/highlighter/lucene-highlighter-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/memory/lucene-memory-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/misc/lucene-misc-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/spatial/lucene-spatial-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/suggest/lucene-suggest-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/grouping/lucene-grouping-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queries/lucene-queries-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queryparser/lucene-queryparser-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/cglib-nodep-2.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-cli-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-codec-1.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-fileupload-1.2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-lang-2.6.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/easymock-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/guava-13.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/javax.servlet-api-3.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/metrics-core-2.1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/objenesis-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/spatial4j-0.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/commons-io-2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpclient-4.1.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpcore-4.1.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpmime-4.1.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/jcl-over-slf4j-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/log4j-over-slf4j-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-api-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-jdk14-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/wstx-asl-3.2.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/zookeeper-3.4.5.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-continuation-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-deploy-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-http-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-io-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-jmx-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-security-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-server-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-servlet-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-util-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-webapp-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-xml-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/servlet-api-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/hsqldb-1.8.0.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/junit-4.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/randomizedtesting-runner-2.0.5.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-launcher.jar:/var/lib/jenkins/.ant/lib/ivy-2.2.0.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jdepend.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-netrexx.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-antlr.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-commons-net.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-javamail.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-regexp.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jsch.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-xalan2.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-junit4.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jmf.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-junit.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-bcel.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jai.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-commons-logging.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-resolver.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-oro.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-swing.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-bsf.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-log4j.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-testutil.jar:/opt/ibm/java-i386-60/lib/tools.jar:/var/lib/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.0.5.jar
[junit4:junit4]   2> 29 T166 oaz.Environment.logEnv Server environment:java.library.path=/opt/ibm/java-i386-60/jre/lib/i386:/usr/lib/jvm/j2sdk1.6-sun/jre/lib/amd64/server:/usr/lib/jvm/j2sdk1.6-sun/jre/lib/amd64:/usr/lib/jvm/j2sdk1.6-sun/jre/../lib/amd64:/usr/lib
[junit4:junit4]   2> 29 T166 oaz.Environment.logEnv Server environment:java.io.tmpdir=.
[junit4:junit4]   2> 30 T166 oaz.Environment.logEnv Server environment:java.compiler=j9jit24
[junit4:junit4]   2> 30 T166 oaz.Environment.logEnv Server environment:os.name=Linux
[junit4:junit4]   2> 31 T166 oaz.Environment.logEnv Server environment:os.arch=x86
[junit4:junit4]   2> 31 T166 oaz.Environment.logEnv Server environment:os.version=3.2.0-34-generic
[junit4:junit4]   2> 32 T166 oaz.Environment.logEnv Server environment:user.name=jenkins
[junit4:junit4]   2> 33 T166 oaz.Environment.logEnv Server environment:user.home=/var/lib/jenkins
[junit4:junit4]   2> 33 T166 oaz.Environment.logEnv Server environment:user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 43 T166 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 43 T166 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4]   2> 44 T166 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4]   2> 46 T166 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 62 T166 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1355296550414/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4]   2> 111 T165 oasc.ZkTestServer.run start zk server on port:57726
[junit4:junit4]   2> 127 T165 oaz.Environment.logEnv Client environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
[junit4:junit4]   2> 128 T165 oaz.Environment.logEnv Client environment:host.name=serv1
[junit4:junit4]   2> 129 T165 oaz.Environment.logEnv Client environment:java.version=1.6.0
[junit4:junit4]   2> 129 T165 oaz.Environment.logEnv Client environment:java.vendor=IBM Corporation
[junit4:junit4]   2> 130 T165 oaz.Environment.logEnv Client environment:java.home=/opt/ibm/java-i386-60/jre
[junit4:junit4]   2> 130 T165 oaz.Environment.logEnv Client environment:java.class.path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/test:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/codecs/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-solrj/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/common/lucene-analyzers-common-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/highlighter/lucene-highlighter-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/memory/lucene-memory-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/misc/lucene-misc-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/spatial/lucene-spatial-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/suggest/lucene-suggest-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/grouping/lucene-grouping-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queries/lucene-queries-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queryparser/lucene-queryparser-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/cglib-nodep-2.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-cli-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-codec-1.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-fileupload-1.2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-lang-2.6.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/easymock-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/guava-13.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/javax.servlet-api-3.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/metrics-core-2.1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/objenesis-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/spatial4j-0.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/commons-io-2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpclient-4.1.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpcore-4.1.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpmime-4.1.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/jcl-over-slf4j-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/log4j-over-slf4j-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-api-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-jdk14-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/wstx-asl-3.2.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/zookeeper-3.4.5.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-continuation-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-deploy-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-http-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-io-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-jmx-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-security-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-server-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-servlet-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-util-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-webapp-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-xml-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/servlet-api-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/hsqldb-1.8.0.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/junit-4.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/randomizedtesting-runner-2.0.5.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-launcher.jar:/var/lib/jenkins/.ant/lib/ivy-2.2.0.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jdepend.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-netrexx.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-antlr.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-commons-net.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-javamail.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-regexp.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jsch.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-xalan2.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-junit4.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jmf.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-junit.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-bcel.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jai.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-commons-logging.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-resolver.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-oro.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-swing.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-bsf.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-log4j.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-testutil.jar:/opt/ibm/java-i386-60/lib/tools.jar:/var/lib/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.0.5.jar
[junit4:junit4]   2> 131 T165 oaz.Environment.logEnv Client environment:java.library.path=/opt/ibm/java-i386-60/jre/lib/i386:/usr/lib/jvm/j2sdk1.6-sun/jre/lib/amd64/server:/usr/lib/jvm/j2sdk1.6-sun/jre/lib/amd64:/usr/lib/jvm/j2sdk1.6-sun/jre/../lib/amd64:/usr/lib
[junit4:junit4]   2> 132 T165 oaz.Environment.logEnv Client environment:java.io.tmpdir=.
[junit4:junit4]   2> 132 T165 oaz.Environment.logEnv Client environment:java.compiler=j9jit24
[junit4:junit4]   2> 133 T165 oaz.Environment.logEnv Client environment:os.name=Linux
[junit4:junit4]   2> 133 T165 oaz.Environment.logEnv Client environment:os.arch=x86
[junit4:junit4]   2> 134 T165 oaz.Environment.logEnv Client environment:os.version=3.2.0-34-generic
[junit4:junit4]   2> 135 T165 oaz.Environment.logEnv Client environment:user.name=jenkins
[junit4:junit4]   2> 135 T165 oaz.Environment.logEnv Client environment:user.home=/var/lib/jenkins
[junit4:junit4]   2> 136 T165 oaz.Environment.logEnv Client environment:user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 137 T165 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57726 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@34f034f
[junit4:junit4]   2> 148 T165 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 150 T171 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:57726. Will not attempt to authenticate using SASL (Access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 151 T171 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:57726, initiating session
[junit4:junit4]   2> 151 T167 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50229
[junit4:junit4]   2> 159 T167 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50229
[junit4:junit4]   2> 161 T169 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 328 T169 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8df82e4f0000 with negotiated timeout 10000 for client /127.0.0.1:50229
[junit4:junit4]   2> 328 T171 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:57726, sessionid = 0x13b8df82e4f0000, negotiated timeout = 10000
[junit4:junit4]   2> 330 T172 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@34f034f name:ZooKeeperConnection Watcher:127.0.0.1:57726 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 331 T165 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 332 T165 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 350 T170 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8df82e4f0000
[junit4:junit4]   2> 351 T172 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 351 T165 oaz.ZooKeeper.close Session: 0x13b8df82e4f0000 closed
[junit4:junit4]   2> 351 T167 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50229 which had sessionid 0x13b8df82e4f0000
[junit4:junit4]   2> 352 T165 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57726/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@7ca67ca6
[junit4:junit4]   2> 353 T165 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 354 T173 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:57726. Will not attempt to authenticate using SASL (Access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 355 T173 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:57726, initiating session
[junit4:junit4]   2> 355 T167 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50230
[junit4:junit4]   2> 356 T167 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50230
[junit4:junit4]   2> 357 T169 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8df82e4f0001 with negotiated timeout 10000 for client /127.0.0.1:50230
[junit4:junit4]   2> 357 T173 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:57726, sessionid = 0x13b8df82e4f0001, negotiated timeout = 10000
[junit4:junit4]   2> 358 T174 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7ca67ca6 name:ZooKeeperConnection Watcher:127.0.0.1:57726/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 359 T165 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 360 T165 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 367 T165 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 380 T165 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 385 T165 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 392 T165 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 393 T165 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 402 T165 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 404 T165 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 411 T165 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 412 T165 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 419 T165 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 420 T165 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 426 T165 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 427 T165 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 433 T165 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 434 T165 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 440 T165 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 440 T165 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 447 T165 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 447 T165 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 453 T165 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 454 T165 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 459 T165 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 460 T165 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 466 T170 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8df82e4f0001
[junit4:junit4]   2> 467 T167 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50230 which had sessionid 0x13b8df82e4f0001
[junit4:junit4]   2> 467 T165 oaz.ZooKeeper.close Session: 0x13b8df82e4f0001 closed
[junit4:junit4]   2> 467 T174 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 587 T165 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 590 T165 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:55053
[junit4:junit4]   2> 591 T165 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 592 T165 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1355296550876
[junit4:junit4]   2> 592 T165 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1355296550876/'
[junit4:junit4]   2> 608 T165 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 609 T165 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 610 T165 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1355296550876
[junit4:junit4]   2> 610 T165 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1355296550876/solr.xml
[junit4:junit4]   2> 611 T165 oasc.CoreContainer.<init> New CoreContainer 1244219945
[junit4:junit4]   2> 612 T165 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1355296550876/'
[junit4:junit4]   2> 613 T165 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1355296550876/'
[junit4:junit4]   2> 628 T165 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 638 T165 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:57726/solr
[junit4:junit4]   2> 644 T165 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 644 T165 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57726 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@4810481
[junit4:junit4]   2> 646 T165 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 647 T184 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:57726. Will not attempt to authenticate using SASL (Access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 648 T184 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:57726, initiating session
[junit4:junit4]   2> 648 T167 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50231
[junit4:junit4]   2> 649 T167 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50231
[junit4:junit4]   2> 650 T169 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8df82e4f0002 with negotiated timeout 20000 for client /127.0.0.1:50231
[junit4:junit4]   2> 650 T184 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:57726, sessionid = 0x13b8df82e4f0002, negotiated timeout = 20000
[junit4:junit4]   2> 651 T185 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4810481 name:ZooKeeperConnection Watcher:127.0.0.1:57726 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 651 T165 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 654 T170 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8df82e4f0002
[junit4:junit4]   2> 655 T167 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50231 which had sessionid 0x13b8df82e4f0002
[junit4:junit4]   2> 655 T185 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 655 T165 oaz.ZooKeeper.close Session: 0x13b8df82e4f0002 closed
[junit4:junit4]   2> 657 T165 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57726/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@6f836f83
[junit4:junit4]   2> 659 T165 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 701 T186 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:57726. Will not attempt to authenticate using SASL (Access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 702 T186 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:57726, initiating session
[junit4:junit4]   2> 702 T167 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50232
[junit4:junit4]   2> 703 T167 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50232
[junit4:junit4]   2> 705 T169 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8df82e4f0003 with negotiated timeout 8000 for client /127.0.0.1:50232
[junit4:junit4]   2> 705 T186 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:57726, sessionid = 0x13b8df82e4f0003, negotiated timeout = 8000
[junit4:junit4]   2> 706 T187 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6f836f83 name:ZooKeeperConnection Watcher:127.0.0.1:57726/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 706 T165 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 712 T170 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8df82e4f0003 type:create cxid:0x2 zxid:0x1b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 716 T165 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 722 T165 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55053_solr
[junit4:junit4]   2> 724 T170 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8df82e4f0003 type:delete cxid:0x7 zxid:0x1d txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:55053_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:55053_solr
[junit4:junit4]   2> 726 T165 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55053_solr
[junit4:junit4]   2> 732 T165 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 733 T165 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 734 T165 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 734 T165 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 735 T165 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 736 T165 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 736 T165 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 737 T165 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 737 T165 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 738 T165 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 746 T165 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 759 T170 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8df82e4f0003 type:delete cxid:0x15 zxid:0x22 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 760 T165 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 766 T165 oasc.Overseer.start Overseer (id=88820714732191747-127.0.0.1:55053_solr-n_0000000000) starting
[junit4:junit4]   2> 767 T170 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8df82e4f0003 type:create cxid:0x1a zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 776 T170 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8df82e4f0003 type:create cxid:0x1b zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 778 T170 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8df82e4f0003 type:create cxid:0x1c zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 781 T170 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8df82e4f0003 type:create cxid:0x1d zxid:0x27 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 783 T189 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
[junit4:junit4]   2> 784 T165 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 790 T165 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 798 T188 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 802 T190 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1355296550876/collection1
[junit4:junit4]   2> 803 T190 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4]   2> 805 T190 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 805 T190 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4]   2> 808 T190 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1355296550876/collection1/'
[junit4:junit4]   2> 810 T190 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1355296550876/collection1/lib/README' to classloader
[junit4:junit4]   2> 811 T190 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1355296550876/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 846 T190 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 894 T190 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 897 T190 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 903 T190 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 1387 T190 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 1394 T190 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 1397 T190 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 1435 T190 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1443 T190 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1451 T190 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1455 T190 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1458 T190 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1355296550876/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1355296550414/control/data/
[junit4:junit4]   2> 1460 T190 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@60136013
[junit4:junit4]   2> 1466 T190 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1355296550414/control/data/index/
[junit4:junit4]   2> 1467 T190 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1355296550414/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 1468 T190 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1355296550414/control/data/index forceNew:false
[junit4:junit4]   2> 1475 T190 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1355296550414/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@5d595d59; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 1476 T190 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 1477 T190 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 1479 T190 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 1480 T190 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 1480 T190 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 1481 T190 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 1481 T190 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 1482 T190 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 1482 T190 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 1484 T190 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 1485 T190 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 1487 T190 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 1488 T190 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 1489 T190 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 1491 T190 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 1492 T190 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 1492 T190 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 1494 T190 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 1495 T190 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1497 T190 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1498 T190 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1500 T190 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1501 T190 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1503 T190 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1504 T190 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1506 T190 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 1507 T190 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 1509 T190 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 1511 T190 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 1520 T190 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [OLD_SYNONYMS.TXT, PROTWORDS.TXT, STOPWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, CURRENCY.XML, SCHEMA.XML, SYNONYMS.TXT, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 1523 T190 oass.SolrIndexSearcher.<init> Opening Searcher@3a773a77 main
[junit4:junit4]   2> 1524 T190 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 1528 T190 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 1528 T190 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 1529 T190 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 1537 T190 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 1592 T191 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3a773a77 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 1604 T190 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 1605 T190 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 1607 T170 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8df82e4f0003 type:create cxid:0x53 zxid:0x2a txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 1611 T190 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 1611 T190 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:55053/solr shardId:control_shard
[junit4:junit4]   2> 1615 T190 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4]   2> 1626 T190 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/control_shard/election
[junit4:junit4]   2> 1640 T170 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8df82e4f0003 type:delete cxid:0x62 zxid:0x31 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4]   2> 1642 T190 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 1643 T170 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8df82e4f0003 type:create cxid:0x63 zxid:0x32 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1831 T188 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 1833 T188 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:55053/solr",
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:55053_solr",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "shard":"control_shard",
[junit4:junit4]   2> 	  "core":"collection1"}
[junit4:junit4]   2> 1837 T170 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8df82e4f0003 type:create cxid:0x6a zxid:0x34 txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 1894 T187 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 2147 T190 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 2148 T190 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 2149 T190 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:55053/solr/collection1/
[junit4:junit4]   2> 2149 T190 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 2150 T190 oasc.SyncStrategy.syncToMe http://127.0.0.1:55053/solr/collection1/ has no replicas
[junit4:junit4]   2> 2150 T190 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:55053/solr/collection1/
[junit4:junit4]   2> 2151 T190 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/control_shard
[junit4:junit4]   2> 2161 T170 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8df82e4f0003 type:create cxid:0x89 zxid:0x3f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2407 T188 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2420 T187 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 2465 T190 oasc.ZkController.register We are http://127.0.0.1:55053/solr/collection1/ and leader is http://127.0.0.1:55053/solr/collection1/
[junit4:junit4]   2> 2466 T190 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:55053/solr
[junit4:junit4]   2> 2467 T190 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 2468 T190 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 2468 T190 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 2472 T190 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2474 T165 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 2475 T165 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 2476 T165 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 2611 T165 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 2613 T165 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:42813
[junit4:junit4]   2> 2614 T165 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 2615 T165 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355296552890
[junit4:junit4]   2> 2616 T165 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355296552890/'
[junit4:junit4]   2> 2631 T165 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 2631 T165 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 2632 T165 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355296552890
[junit4:junit4]   2> 2633 T165 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355296552890/solr.xml
[junit4:junit4]   2> 2634 T165 oasc.CoreContainer.<init> New CoreContainer 590750518
[junit4:junit4]   2> 2635 T165 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355296552890/'
[junit4:junit4]   2> 2636 T165 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355296552890/'
[junit4:junit4]   2> 2658 T165 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 2669 T165 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:57726/solr
[junit4:junit4]   2> 2670 T165 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 2670 T165 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57726 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@49db49db
[junit4:junit4]   2> 2672 T165 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2673 T201 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:57726. Will not attempt to authenticate using SASL (Access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 2674 T201 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:57726, initiating session
[junit4:junit4]   2> 2674 T167 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50233
[junit4:junit4]   2> 2675 T167 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50233
[junit4:junit4]   2> 2676 T169 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8df82e4f0004 with negotiated timeout 20000 for client /127.0.0.1:50233
[junit4:junit4]   2> 2677 T201 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:57726, sessionid = 0x13b8df82e4f0004, negotiated timeout = 20000
[junit4:junit4]   2> 2677 T202 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@49db49db name:ZooKeeperConnection Watcher:127.0.0.1:57726 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2678 T165 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2681 T170 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8df82e4f0004
[junit4:junit4]   2> 2682 T167 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50233 which had sessionid 0x13b8df82e4f0004
[junit4:junit4]   2> 2683 T202 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 2683 T165 oaz.ZooKeeper.close Session: 0x13b8df82e4f0004 closed
[junit4:junit4]   2> 2684 T165 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57726/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@500050
[junit4:junit4]   2> 2686 T165 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2686 T203 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:57726. Will not attempt to authenticate using SASL (Access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 2687 T203 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:57726, initiating session
[junit4:junit4]   2> 2687 T167 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50234
[junit4:junit4]   2> 2688 T167 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50234
[junit4:junit4]   2> 2690 T169 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8df82e4f0005 with negotiated timeout 8000 for client /127.0.0.1:50234
[junit4:junit4]   2> 2690 T203 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:57726, sessionid = 0x13b8df82e4f0005, negotiated timeout = 8000
[junit4:junit4]   2> 2691 T204 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@500050 name:ZooKeeperConnection Watcher:127.0.0.1:57726/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2691 T165 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2692 T170 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8df82e4f0005 type:create cxid:0x1 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2694 T170 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8df82e4f0005 type:create cxid:0x2 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2696 T165 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42813_solr
[junit4:junit4]   2> 2697 T170 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8df82e4f0005 type:delete cxid:0x4 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:42813_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:42813_solr
[junit4:junit4]   2> 2698 T165 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:42813_solr
[junit4:junit4]   2> 2702 T187 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 2707 T165 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 2707 T187 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 2708 T165 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 2709 T165 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 2710 T165 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 2711 T165 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 2711 T165 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 2712 T165 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 2713 T165 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 2713 T165 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 2714 T165 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 2738 T165 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 2783 T205 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355296552890/collection1
[junit4:junit4]   2> 2784 T205 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 2786 T205 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 2787 T205 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 2789 T205 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355296552890/collection1/'
[junit4:junit4]   2> 2791 T205 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty1-1355296552890/collection1/lib/README' to classloader
[junit4:junit4]   2> 2792 T205 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty1-1355296552890/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 2838 T205 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 2887 T205 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 2889 T205 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 2897 T205 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 2931 T188 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2933 T188 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:55053/solr",
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:55053_solr",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "shard":"control_shard",
[junit4:junit4]   2> 	  "core":"collection1"}
[junit4:junit4]   2> 2946 T187 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 2947 T204 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3376 T205 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 3382 T205 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 3385 T205 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 3416 T205 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 3423 T205 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 3431 T205 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 3437 T205 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 3440 T205 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355296552890/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1355296550414/jetty1/
[junit4:junit4]   2> 3441 T205 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@60136013
[junit4:junit4]   2> 3443 T205 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1355296550414/jetty1/index/
[junit4:junit4]   2> 3444 T205 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1355296550414/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 3446 T205 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1355296550414/jetty1/index forceNew:false
[junit4:junit4]   2> 3453 T205 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1355296550414/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@12b312b3; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 3454 T205 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 3455 T205 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 3458 T205 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 3459 T205 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 3459 T205 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 3460 T205 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 3461 T205 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 3461 T205 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 3462 T205 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 3464 T205 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 3466 T205 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 3469 T205 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 3471 T205 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 3472 T205 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 3475 T205 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 3475 T205 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 3476 T205 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 3479 T205 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 3480 T205 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3483 T205 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3485 T205 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3487 T205 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3489 T205 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3490 T205 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3492 T205 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3494 T205 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 3496 T205 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 3497 T205 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 3499 T205 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 3502 T205 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [OLD_SYNONYMS.TXT, PROTWORDS.TXT, STOPWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, CURRENCY.XML, SCHEMA.XML, SYNONYMS.TXT, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 3504 T205 oass.SolrIndexSearcher.<init> Opening Searcher@4b3f4b3f main
[junit4:junit4]   2> 3505 T205 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 3506 T205 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 3506 T205 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 3507 T205 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 3522 T205 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 3576 T206 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4b3f4b3f main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 3588 T205 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 3588 T205 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 3965 T188 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3967 T188 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:42813/solr",
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:42813_solr",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "core":"collection1"}
[junit4:junit4]   2> 3967 T188 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4]   2> 3969 T188 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 3976 T187 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3976 T204 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 4091 T205 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 4091 T205 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:42813/solr shardId:shard1
[junit4:junit4]   2> 4093 T205 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 4106 T170 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8df82e4f0005 type:delete cxid:0x45 zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 4107 T205 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 4108 T170 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8df82e4f0005 type:create cxid:0x46 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4111 T205 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 4112 T205 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 4112 T205 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:42813/solr/collection1/
[junit4:junit4]   2> 4162 T205 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 4162 T205 oasc.SyncStrategy.syncToMe http://127.0.0.1:42813/solr/collection1/ has no replicas
[junit4:junit4]   2> 4163 T205 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:42813/solr/collection1/
[junit4:junit4]   2> 4164 T205 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 4174 T170 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8df82e4f0005 type:create cxid:0x50 zxid:0x60 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4490 T188 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4507 T187 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 4508 T204 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 4529 T205 oasc.ZkController.register We are http://127.0.0.1:42813/solr/collection1/ and leader is http://127.0.0.1:42813/solr/collection1/
[junit4:junit4]   2> 4529 T205 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:42813/solr
[junit4:junit4]   2> 4530 T205 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 4531 T205 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 4531 T205 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 4535 T205 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4538 T165 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 4538 T165 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 4539 T165 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 4665 T165 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 4668 T165 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:36945
[junit4:junit4]   2> 4669 T165 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 4670 T165 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355296554953
[junit4:junit4]   2> 4670 T165 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355296554953/'
[junit4:junit4]   2> 4684 T165 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 4685 T165 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 4686 T165 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355296554953
[junit4:junit4]   2> 4687 T165 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355296554953/solr.xml
[junit4:junit4]   2> 4687 T165 oasc.CoreContainer.<init> New CoreContainer 1037188562
[junit4:junit4]   2> 4688 T165 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355296554953/'
[junit4:junit4]   2> 4689 T165 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355296554953/'
[junit4:junit4]   2> 4706 T165 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 4718 T165 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:57726/solr
[junit4:junit4]   2> 4718 T165 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 4719 T165 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57726 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@27982798
[junit4:junit4]   2> 4721 T165 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4721 T216 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:57726. Will not attempt to authenticate using SASL (Access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 4722 T216 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:57726, initiating session
[junit4:junit4]   2> 4722 T167 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50235
[junit4:junit4]   2> 4723 T167 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50235
[junit4:junit4]   2> 4724 T169 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8df82e4f0006 with negotiated timeout 20000 for client /127.0.0.1:50235
[junit4:junit4]   2> 4724 T216 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:57726, sessionid = 0x13b8df82e4f0006, negotiated timeout = 20000
[junit4:junit4]   2> 4725 T217 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@27982798 name:ZooKeeperConnection Watcher:127.0.0.1:57726 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4726 T165 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4728 T170 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8df82e4f0006
[junit4:junit4]   2> 4729 T167 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50235 which had sessionid 0x13b8df82e4f0006
[junit4:junit4]   2> 4729 T217 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 4729 T165 oaz.ZooKeeper.close Session: 0x13b8df82e4f0006 closed
[junit4:junit4]   2> 4730 T165 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57726/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@47ac47ac
[junit4:junit4]   2> 4732 T165 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4732 T218 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:57726. Will not attempt to authenticate using SASL (Access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 4733 T218 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:57726, initiating session
[junit4:junit4]   2> 4733 T167 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50236
[junit4:junit4]   2> 4734 T167 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50236
[junit4:junit4]   2> 4735 T169 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8df82e4f0007 with negotiated timeout 8000 for client /127.0.0.1:50236
[junit4:junit4]   2> 4735 T218 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:57726, sessionid = 0x13b8df82e4f0007, negotiated timeout = 8000
[junit4:junit4]   2> 4736 T219 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@47ac47ac name:ZooKeeperConnection Watcher:127.0.0.1:57726/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4737 T165 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4738 T170 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8df82e4f0007 type:create cxid:0x1 zxid:0x6d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4739 T170 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8df82e4f0007 type:create cxid:0x2 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4741 T165 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36945_solr
[junit4:junit4]   2> 4742 T170 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8df82e4f0007 type:delete cxid:0x4 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:36945_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:36945_solr
[junit4:junit4]   2> 4743 T165 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:36945_solr
[junit4:junit4]   2> 4749 T187 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 4751 T204 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 4751 T204 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4753 T187 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 4757 T165 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 4758 T165 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 4759 T165 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 4760 T165 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 4761 T165 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 4762 T165 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 4763 T165 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 4764 T165 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 4765 T165 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 4766 T165 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 4782 T165 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 4836 T220 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355296554953/collection1
[junit4:junit4]   2> 4836 T220 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 4838 T220 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 4838 T220 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 4842 T220 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355296554953/collection1/'
[junit4:junit4]   2> 4844 T220 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty2-1355296554953/collection1/lib/README' to classloader
[junit4:junit4]   2> 4845 T220 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty2-1355296554953/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 4906 T220 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 4973 T220 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 4975 T220 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 4984 T220 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 5021 T188 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5023 T188 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:42813/solr",
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:42813_solr",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "core":"collection1"}
[junit4:junit4]   2> 5030 T219 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5030 T204 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5032 T187 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5496 T220 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 5502 T220 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 5505 T220 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 5537 T220 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5547 T220 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5556 T220 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5560 T220 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5563 T220 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355296554953/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1355296550414/jetty2/
[junit4:junit4]   2> 5564 T220 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@60136013
[junit4:junit4]   2> 5565 T220 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1355296550414/jetty2/index/
[junit4:junit4]   2> 5567 T220 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1355296550414/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 5568 T220 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1355296550414/jetty2/index forceNew:false
[junit4:junit4]   2> 5576 T220 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1355296550414/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@64576457; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 5577 T220 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 5578 T220 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 5581 T220 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 5581 T220 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 5582 T220 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 5583 T220 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 5583 T220 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 5584 T220 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 5585 T220 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 5587 T220 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 5588 T220 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 5590 T220 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 5592 T220 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 5593 T220 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 5595 T220 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 5595 T220 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 5596 T220 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 5597 T220 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 5599 T220 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5601 T220 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5603 T220 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5604 T220 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5606 T220 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5608 T220 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5609 T220 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5611 T220 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 5613 T220 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 5614 T220 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 5616 T220 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 5619 T220 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [OLD_SYNONYMS.TXT, PROTWORDS.TXT, STOPWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, CURRENCY.XML, SCHEMA.XML, SYNONYMS.TXT, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 5622 T220 oass.SolrIndexSearcher.<init> Opening Searcher@4aa44aa4 main
[junit4:junit4]   2> 5622 T220 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 5623 T220 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 5624 T220 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 5625 T220 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 5632 T220 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 5691 T221 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4aa44aa4 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 5709 T220 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 5710 T220 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 6048 T188 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6050 T188 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:36945/solr",
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:36945_solr",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "core":"collection1"}
[junit4:junit4]   2> 6050 T188 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 6050 T188 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4]   2> 6059 T187 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 6059 T204 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 6059 T219 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 6212 T220 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 6213 T220 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:36945/solr shardId:shard2
[junit4:junit4]   2> 6215 T220 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4]   2> 6228 T170 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8df82e4f0007 type:delete cxid:0x44 zxid:0x7e txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard2 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard2
[junit4:junit4]   2> 6229 T220 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 6230 T170 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8df82e4f0007 type:create cxid:0x45 zxid:0x7f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6234 T220 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 6235 T220 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 6236 T220 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:36945/solr/collection1/
[junit4:junit4]   2> 6236 T220 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 6236 T220 oasc.SyncStrategy.syncToMe http://127.0.0.1:36945/solr/collection1/ has no replicas
[junit4:junit4]   2> 6237 T220 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:36945/solr/collection1/
[junit4:junit4]   2> 6238 T220 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4]   2> 6246 T170 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8df82e4f0007 type:create cxid:0x4e zxid:0x82 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6614 T188 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6630 T204 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 6630 T219 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 6631 T187 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 6650 T220 oasc.ZkController.register We are http://127.0.0.1:36945/solr/collection1/ and leader is http://127.0.0.1:36945/solr/collection1/
[junit4:junit4]   2> 6651 T220 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:36945/solr
[junit4:junit4]   2> 6652 T220 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 6652 T220 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 6653 T220 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 6666 T220 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6668 T165 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 6668 T165 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 6669 T165 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 6788 T165 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 6790 T165 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:35440
[junit4:junit4]   2> 6792 T165 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 6792 T165 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355296557083
[junit4:junit4]   2> 6793 T165 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355296557083/'
[junit4:junit4]   2> 6806 T165 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 6807 T165 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 6808 T165 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355296557083
[junit4:junit4]   2> 6808 T165 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355296557083/solr.xml
[junit4:junit4]   2> 6809 T165 oasc.CoreContainer.<init> New CoreContainer 470227975
[junit4:junit4]   2> 6810 T165 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355296557083/'
[junit4:junit4]   2> 6811 T165 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355296557083/'
[junit4:junit4]   2> 6828 T165 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 6842 T165 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:57726/solr
[junit4:junit4]   2> 6843 T165 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 6843 T165 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57726 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@daf0daf
[junit4:junit4]   2> 6845 T165 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6846 T231 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:57726. Will not attempt to authenticate using SASL (Access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 6846 T231 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:57726, initiating session
[junit4:junit4]   2> 6847 T167 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50237
[junit4:junit4]   2> 6848 T167 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50237
[junit4:junit4]   2> 6849 T169 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8df82e4f0008 with negotiated timeout 20000 for client /127.0.0.1:50237
[junit4:junit4]   2> 6849 T231 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:57726, sessionid = 0x13b8df82e4f0008, negotiated timeout = 20000
[junit4:junit4]   2> 6850 T232 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@daf0daf name:ZooKeeperConnection Watcher:127.0.0.1:57726 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6850 T165 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6852 T170 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8df82e4f0008
[junit4:junit4]   2> 6853 T167 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50237 which had sessionid 0x13b8df82e4f0008
[junit4:junit4]   2> 6853 T232 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 6853 T165 oaz.ZooKeeper.close Session: 0x13b8df82e4f0008 closed
[junit4:junit4]   2> 6855 T165 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57726/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@1aa91aa9
[junit4:junit4]   2> 6856 T165 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6857 T233 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:57726. Will not attempt to authenticate using SASL (Access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 6858 T233 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:57726, initiating session
[junit4:junit4]   2> 6858 T167 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50238
[junit4:junit4]   2> 6859 T167 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50238
[junit4:junit4]   2> 6860 T169 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8df82e4f0009 with negotiated timeout 8000 for client /127.0.0.1:50238
[junit4:junit4]   2> 6860 T233 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:57726, sessionid = 0x13b8df82e4f0009, negotiated timeout = 8000
[junit4:junit4]   2> 6861 T234 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1aa91aa9 name:ZooKeeperConnection Watcher:127.0.0.1:57726/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6862 T165 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6863 T170 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8df82e4f0009 type:create cxid:0x1 zxid:0x8f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6865 T170 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8df82e4f0009 type:create cxid:0x2 zxid:0x90 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6867 T165 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35440_solr
[junit4:junit4]   2> 6913 T170 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8df82e4f0009 type:delete cxid:0x4 zxid:0x91 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:35440_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:35440_solr
[junit4:junit4]   2> 6915 T165 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:35440_solr
[junit4:junit4]   2> 6919 T187 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 6920 T219 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 6921 T219 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6921 T204 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 6922 T204 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6923 T165 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 6924 T165 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 6925 T187 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 6925 T165 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 6926 T165 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 6927 T165 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 6928 T165 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 6928 T165 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 6929 T165 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 6930 T165 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 6931 T165 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 6943 T165 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 6956 T235 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355296557083/collection1
[junit4:junit4]   2> 6957 T235 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 6961 T235 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 6962 T235 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 6966 T235 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355296557083/collection1/'
[junit4:junit4]   2> 6967 T235 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty3-1355296557083/collection1/lib/README' to classloader
[junit4:junit4]   2> 6968 T235 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty3-1355296557083/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 7032 T235 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 7100 T235 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 7103 T235 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 7111 T235 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 7147 T188 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7149 T188 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:36945/solr",
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:36945_solr",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "core":"collection1"}
[junit4:junit4]   2> 7157 T187 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 7157 T234 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 7157 T204 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 7158 T219 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 7687 T235 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 7693 T235 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 7696 T235 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 7725 T235 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 7732 T235 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 7739 T235 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 7743 T235 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 7746 T235 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355296557083/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1355296550414/jetty3/
[junit4:junit4]   2> 7747 T235 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@60136013
[junit4:junit4]   2> 7749 T235 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1355296550414/jetty3/index/
[junit4:junit4]   2> 7750 T235 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1355296550414/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 7751 T235 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1355296550414/jetty3/index forceNew:false
[junit4:junit4]   2> 7758 T235 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1355296550414/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@746f746f; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 7759 T235 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 7761 T235 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 7765 T235 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 7765 T235 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 7766 T235 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 7767 T235 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 7768 T235 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 7768 T235 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 7770 T235 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 7772 T235 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 7775 T235 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 7778 T235 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 7780 T235 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 7782 T235 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 7784 T235 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 7785 T235 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 7786 T235 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 7789 T235 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 7791 T235 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7794 T235 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7797 T235 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7799 T235 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7802 T235 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7805 T235 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7807 T235 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7810 T235 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 7813 T235 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 7815 T235 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 7817 T235 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 7821 T235 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [OLD_SYNONYMS.TXT, PROTWORDS.TXT, STOPWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, CURRENCY.XML, SCHEMA.XML, SYNONYMS.TXT, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 7825 T235 oass.SolrIndexSearcher.<init> Opening Searcher@19771977 main
[junit4:junit4]   2> 7826 T235 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 7828 T235 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 7829 T235 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 7830 T235 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 7839 T235 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 7952 T236 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@19771977 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 7972 T235 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 7972 T235 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 8174 T188 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8176 T188 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:35440/solr",
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:35440_solr",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "core":"collection1"}
[junit4:junit4]   2> 8177 T188 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 8177 T188 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 8273 T219 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 8273 T204 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 8273 T234 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 8273 T187 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 8475 T235 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 8475 T235 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:35440/solr shardId:shard1
[junit4:junit4]   2> 8482 T235 oasc.ZkController.register We are http://127.0.0.1:35440/solr/collection1/ and leader is http://127.0.0.1:42813/solr/collection1/
[junit4:junit4]   2> 8483 T235 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:35440/solr
[junit4:junit4]   2> 8484 T235 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 8484 T235 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C7 name=collection1 org.apache.solr.core.SolrCore@647c647c url=http://127.0.0.1:35440/solr/collection1 node=127.0.0.1:35440_solr
[junit4:junit4]   2> 8487 T237 C7 P35440 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 8488 T237 C7 P35440 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 8488 T237 C7 P35440 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 8488 T235 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8489 T237 C7 P35440 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 8492 T165 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 8492 T165 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 8493 T165 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 8494 T237 C7 P35440 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:42813/solr/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 8497 T237 C7 P35440 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4]   2> 8503 T237 C7 P35440 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:35440/solr START replicas=[http://127.0.0.1:42813/solr/collection1/] nUpdates=100
[junit4:junit4]   2> 8504 T237 C7 P35440 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 8505 T237 C7 P35440 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 8505 T237 C7 P35440 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 8506 T237 C7 P35440 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C8 name=collection1 org.apache.solr.core.SolrCore@1ace1ace url=http://127.0.0.1:42813/solr/collection1 node=127.0.0.1:42813_solr
[junit4:junit4]   2> 8517 T198 C8 P42813 REQ /get {version=2&getVersions=100&qt=/get&wt=javabin&distrib=false} status=0 QTime=0 
[junit4:junit4]   2> 8623 T165 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 8626 T165 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:41582
[junit4:junit4]   2> 8627 T165 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 8627 T165 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355296558907
[junit4:junit4]   2> 8628 T165 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355296558907/'
[junit4:junit4]   2> 8641 T165 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 8641 T165 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 8642 T165 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355296558907
[junit4:junit4]   2> 8643 T165 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355296558907/solr.xml
[junit4:junit4]   2> 8643 T165 oasc.CoreContainer.<init> New CoreContainer 101910035
[junit4:junit4]   2> 8644 T165 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355296558907/'
[junit4:junit4]   2> 8645 T165 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355296558907/'
[junit4:junit4]   2> 8665 T165 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 8682 T165 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:57726/solr
[junit4:junit4]   2> 8683 T165 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 8684 T165 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57726 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@3e2a3e2a
[junit4:junit4]   2> 8685 T165 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 8688 T248 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:57726. Will not attempt to authenticate using SASL (Access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 8689 T248 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:57726, initiating session
[junit4:junit4]   2> 8689 T167 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50244
[junit4:junit4]   2> 8690 T167 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50244
[junit4:junit4]   2> 8691 T169 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8df82e4f000a with negotiated timeout 20000 for client /127.0.0.1:50244
[junit4:junit4]   2> 8691 T248 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:57726, sessionid = 0x13b8df82e4f000a, negotiated timeout = 20000
[junit4:junit4]   2> 8692 T249 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3e2a3e2a name:ZooKeeperConnection Watcher:127.0.0.1:57726 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 8693 T165 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 8696 T170 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8df82e4f000a
[junit4:junit4]   2> 8696 T167 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50244 which had sessionid 0x13b8df82e4f000a
[junit4:junit4]   2> 8697 T249 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 8697 T165 oaz.ZooKeeper.close Session: 0x13b8df82e4f000a closed
[junit4:junit4]   2> 8698 T165 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57726/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@3e793e79
[junit4:junit4]   2> 8699 T165 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 8700 T250 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:57726. Will not attempt to authenticate using SASL (Access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 8701 T250 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:57726, initiating session
[junit4:junit4]   2> 8701 T167 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50245
[junit4:junit4]   2> 8702 T167 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50245
[junit4:junit4]   2> 8704 T169 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8df82e4f000b with negotiated timeout 8000 for client /127.0.0.1:50245
[junit4:junit4]   2> 8704 T250 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:57726, sessionid = 0x13b8df82e4f000b, negotiated timeout = 8000
[junit4:junit4]   2> 8704 T251 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3e793e79 name:ZooKeeperConnection Watcher:127.0.0.1:57726/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 8705 T165 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 8706 T170 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8df82e4f000b type:create cxid:0x1 zxid:0xa2 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 8708 T170 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8df82e4f000b type:create cxid:0x2 zxid:0xa3 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 8709 T165 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41582_solr
[junit4:junit4]   2> 8710 T170 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8df82e4f000b type:delete cxid:0x4 zxid:0xa4 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:41582_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:41582_solr
[junit4:junit4]   2> 8711 T165 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:41582_solr
[junit4:junit4]   2> 8715 T187 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 8717 T204 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 8718 T204 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8719 T219 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 8720 T234 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 8720 T219 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8721 T234 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8723 T187 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 8725 T165 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 8726 T165 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 8728 T165 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 8729 T165 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 8730 T165 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 8731 T165 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 8732 T165 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 8771 T165 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 8772 T165 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 8773 T165 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 8787 T188 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8788 T165 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 8789 T188 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:35440/solr",
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:35440_solr",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "core":"collection1"}
[junit4:junit4]   2> 8798 T187 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8798 T234 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8799 T251 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8799 T252 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355296558907/collection1
[junit4:junit4]   2> 8798 T204 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8801 T252 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 8798 T219 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8805 T252 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 8805 T252 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 8808 T252 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355296558907/collection1/'
[junit4:junit4]   2> 8810 T252 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty4-1355296558907/collection1/lib/README' to classloader
[junit4:junit4]   2> 8810 T252 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty4-1355296558907/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 8862 T252 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 8906 T252 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 8908 T252 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 8913 T252 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 9355 T252 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 9361 T252 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 9364 T252 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 9438 T252 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 9445 T252 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 9451 T252 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 9454 T252 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 9457 T252 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355296558907/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1355296550414/jetty4/
[junit4:junit4]   2> 9457 T252 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@60136013
[junit4:junit4]   2> 9459 T252 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1355296550414/jetty4/index/
[junit4:junit4]   2> 9459 T252 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1355296550414/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 9460 T252 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1355296550414/jetty4/index forceNew:false
[junit4:junit4]   2> 9534 T252 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1355296550414/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@2c432c43; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 9535 T252 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 9536 T252 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 9539 T252 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 9540 T252 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 9541 T252 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 9541 T252 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 9542 T252 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 9543 T252 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 9544 T252 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 9546 T252 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 9548 T252 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 9549 T252 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 9551 T252 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 9552 T252 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 9553 T252 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 9554 T252 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 9555 T252 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 9556 T252 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 9558 T252 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9560 T252 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9563 T252 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9565 T252 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9568 T252 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9571 T252 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9573 T252 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9576 T252 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 9579 T252 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 9581 T252 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 9583 T252 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 9587 T252 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [OLD_SYNONYMS.TXT, PROTWORDS.TXT, STOPWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, CURRENCY.XML, SCHEMA.XML, SYNONYMS.TXT, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 9592 T252 oass.SolrIndexSearcher.<init> Opening Searcher@26b026b0 main
[junit4:junit4]   2> 9593 T252 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 9594 T252 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 9595 T252 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 9597 T252 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 9605 T252 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 9656 T253 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@26b026b0 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 9668 T252 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 9669 T252 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 9815 T188 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9816 T188 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:41582/solr",
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:41582_solr",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "core":"collection1"}
[junit4:junit4]   2> 9817 T188 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 9817 T188 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4]   2> 9826 T187 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9826 T234 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9826 T219 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9827 T251 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9827 T204 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10171 T252 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 10171 T252 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:41582/solr shardId:shard2
[junit4:junit4]   2> 10177 T252 oasc.ZkController.register We are http://127.0.0.1:41582/solr/collection1/ and leader is http://127.0.0.1:36945/solr/collection1/
[junit4:junit4]   2> 10177 T252 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:41582/solr
[junit4:junit4]   2> 10178 T252 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 10178 T252 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C9 name=collection1 org.apache.solr.core.SolrCore@5f8e5f8e url=http://127.0.0.1:41582/solr/collection1 node=127.0.0.1:41582_solr
[junit4:junit4]   2> 10179 T254 C9 P41582 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 10179 T254 C9 P41582 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 10180 T252 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10180 T254 C9 P41582 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 10181 T254 C9 P41582 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 10182 T165 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 10183 T254 C9 P41582 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:36945/solr/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 10183 T165 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 10184 T254 C9 P41582 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:41582/solr START replicas=[http://127.0.0.1:36945/solr/collection1/] nUpdates=100
[junit4:junit4]   2> 10185 T254 C9 P41582 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 10185 T165 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 10185 T254 C9 P41582 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 10186 T254 C9 P41582 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 10187 T254 C9 P41582 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C10 name=collection1 org.apache.solr.core.SolrCore@561b561b url=http://127.0.0.1:36945/solr/collection1 node=127.0.0.1:36945_solr
[junit4:junit4]   2> 10192 T212 C10 P36945 REQ /get {version=2&getVersions=100&qt=/get&wt=javabin&distrib=false} status=0 QTime=0 
[junit4:junit4]   2> 10193 T165 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57726/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@40624062
[junit4:junit4]   2> 10195 T165 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 10195 T256 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:57726. Will not attempt to authenticate using SASL (Access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 10196 T256 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:57726, initiating session
[junit4:junit4]   2> 10196 T167 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50249
[junit4:junit4]   2> 10197 T167 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50249
[junit4:junit4]   2> 10198 T169 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8df82e4f000c with negotiated timeout 10000 for client /127.0.0.1:50249
[junit4:junit4]   2> 10198 T256 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:57726, sessionid = 0x13b8df82e4f000c, negotiated timeout = 10000
[junit4:junit4]   2> 10199 T257 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@40624062 name:ZooKeeperConnection Watcher:127.0.0.1:57726/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 10199 T165 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 10201 T165 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 10204 T165 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 10205 T165 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 10211 T165 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> ASYNC  NEW_CORE C11 name=collection1 org.apache.solr.core.SolrCore@435e435e url=http://127.0.0.1:55053/solr/collection1 node=127.0.0.1:55053_solr
[junit4:junit4]   2> 10223 T183 C11 P55053 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16
[junit4:junit4]   2> 10237 T183 C11 P55053 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1355296550414/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@5d595d59; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 10239 T183 C11 P55053 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 10251 T183 C11 P55053 /update {version=2&wt=javabin} {add=[1 (1421131446369648640)]} 0 30
[junit4:junit4]   2> 10252 T165 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57726/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@2510251
[junit4:junit4]   2> 10254 T165 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 10255 T258 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:57726. Will not attempt to authenticate using SASL (Access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 10255 T258 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:57726, initiating session
[junit4:junit4]   2> 10256 T167 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50251
[junit4:junit4]   2> 10257 T167 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50251
[junit4:junit4]   2> 10258 T169 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8df82e4f000d with negotiated timeout 10000 for client /127.0.0.1:50251
[junit4:junit4]   2> 10258 T258 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:57726, sessionid = 0x13b8df82e4f000d, negotiated timeout = 10000
[junit4:junit4]   2> 10259 T259 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2510251 name:ZooKeeperConnection Watcher:127.0.0.1:57726/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 10259 T165 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 10260 T165 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 10292 T198 C8 P42813 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1355296550414/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@12b312b3; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 10294 T198 C8 P42813 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2>  C7_STATE=coll:collection1 core:collection1 props:{base_url=http://127.0.0.1:35440/solr, state=recovering, node_name=127.0.0.1:35440_solr, roles=null, collection=collection1, shard=shard1, core=collection1}
[junit4:junit4]   2> 10313 T227 C7 P35440 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1355296550414/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@746f746f; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 10315 T227 C7 P35440 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 10321 T227 C7 P35440 REQ /update {update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:42813/solr/collection1/&version=2&wt=javabin} status=0 QTime=14 
[junit4:junit4]   2> 10323 T198 C8 P42813 REQ /update {update.distrib=TOLEADER&distrib.from=http://127.0.0.1:36945/solr/collection1/&version=2&wt=javabin} status=0 QTime=37 
[junit4:junit4]   2> 10324 T213 C10 P36945 /update {version=2&wt=javabin} {add=[1]} 0 48
[junit4:junit4]   2> 10329 T180 C11 P55053 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 10382 T188 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10384 T188 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:41582/solr",
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:41582_solr",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "core":"collection1"}
[junit4:junit4]   2> 10505 T234 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10505 T259 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10506 T257 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10507 T251 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10506 T204 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10510 T219 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10511 T187 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10532 T180 C11 P55053 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1355296550414/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@5d595d59; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1355296550414/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@5d595d59; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[_0.si, segments_2, _0.pos, _0.fnm, _0.fdt, _0.doc, _0.tim, _0.fdx, _0_nrm.cfs, _0.tip, _0_nrm.cfe]
[junit4:junit4]   2> 10533 T180 C11 P55053 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 10543 T180 C11 P55053 oass.SolrIndexSearcher.<init> Opening Searcher@f840f84 main
[junit4:junit4]   2> 10544 T180 C11 P55053 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 10545 T180 C11 P55053 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 10548 T191 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@f840f84 main{StandardDirectoryReader(segments_2:3 _0(4.1):C1)}
[junit4:junit4]   2> 10548 T180 C11 P55053 /update {version=2&softCommit=false&waitSearcher=true&wt=javabin&commit=true} {commit=} 0 219
[junit4:junit4]   2> 10553 T215 C10 P36945 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 10560 T215 C10 P36945 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1355296550414/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@64576457; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 10562 T215 C10 P36945 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 10572 T215 C10 P36945 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1355296550414/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@64576457; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1355296550414/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@64576457; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 10573 T215 C10 P36945 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 10577 T215 C10 P36945 oass.SolrIndexSearcher.<init> Opening Searcher@2a172a17 main
[junit4:junit4]   2> 10577 T215 C10 P36945 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 10578 T215 C10 P36945 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 10581 T221 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2a172a17 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 10582 T215 C10 P36945 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:42813/solr/collection1/, StdNode: http://127.0.0.1:35440/solr/collection1/, StdNode: http://127.0.0.1:41582/solr/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4]   2> 10587 T200 C8 P42813 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 10588 T229 C7 P35440 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2>  C9_STATE=coll:collection1 core:collection1 props:{base_url=http://127.0.0.1:41582/solr, state=recovering, node_name=127.0.0.1:41582_solr, roles=null, collection=collection1, shard=shard2, core=collection1}
[junit4:junit4]   2> 10593 T246 C9 P41582 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 10600 T246 C9 P41582 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1355296550414/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@2c432c43; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 10601 T246 C9 P41582 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 10623 T246 C9 P41582 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1355296550414/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@2c432c43; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1355296550414/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@2c432c43; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 10624 T246 C9 P41582 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 10628 T246 C9 P41582 oass.SolrIndexSearcher.<init> Opening Searcher@1ed81ed8 main
[junit4:junit4]   2> 10629 T246 C9 P41582 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 10629 T246 C9 P41582 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 10632 T253 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1ed81ed8 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 10633 T246 C9 P41582 /update {softCommit=false&commit_end_point=true&expungeDeletes=false&commit=true&version=2&waitSearcher=true&wt=javabin} {commit=} 0 40
[junit4:junit4]   2> 10652 T200 C8 P42813 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1355296550414/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@12b312b3; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1355296550414/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@12b312b3; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[_0.si, segments_2, _0.pos, _0.fnm, _0.fdt, _0.doc, _0.tim, _0.fdx, _0_nrm.cfs, _0.tip, _0_nrm.cfe]
[junit4:junit4]   2> 10654 T200 C8 P42813 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 10663 T200 C8 P42813 oass.SolrIndexSearcher.<init> Opening Searcher@2bb52bb5 main
[junit4:junit4]   2> 10664 T200 C8 P42813 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 10665 T200 C8 P42813 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 10669 T206 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2bb52bb5 main{StandardDirectoryReader(segments_2:3 _0(4.1):C1)}
[junit4:junit4]   2> 10670 T200 C8 P42813 /update {softCommit=false&commit_end_point=true&expungeDeletes=false&commit=true&version=2&waitSearcher=true&wt=javabin} {commit=} 0 83
[junit4:junit4]   2> 10672 T229 C7 P35440 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1355296550414/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@746f746f; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1355296550414/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@746f746f; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[_0.si, segments_2, _0.pos, _0.fnm, _0.fdt, _0.doc, _0.tim, _0.fdx, _0_nrm.cfs, _0.tip, _0_nrm.cfe]
[junit4:junit4]   2> 10673 T229 C7 P35440 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 10683 T229 C7 P35440 oass.SolrIndexSearcher.<init> Opening Searcher@33e333e3 main
[junit4:junit4]   2> 10684 T229 C7 P35440 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 10685 T229 C7 P35440 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 10688 T236 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@33e333e3 main{StandardDirectoryReader(segments_2:3 _0(4.1):C1)}
[junit4:junit4]   2> 10689 T229 C7 P35440 /update {softCommit=false&commit_end_point=true&expungeDeletes=false&commit=true&version=2&waitSearcher=true&wt=javabin} {commit=} 0 101
[junit4:junit4]   2> 10691 T215 C10 P36945 /update {version=2&softCommit=false&waitSearcher=true&wt=javabin&commit=true} {commit=} 0 138
[junit4:junit4]   2> 10693 T165 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):540
[junit4:junit4]   2> 10694 T165 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 11524 T237 C7 P35440 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 11525 T237 C7 P35440 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 11525 T237 C7 P35440 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:42813/solr/collection1/. core=collection1
[junit4:junit4]   2> 11526 T237 C7 P35440 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 11537 T197 C8 P42813 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 11697 T165 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 11712 T197 C8 P42813 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1355296550414/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@12b312b3; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[_0.si, segments_2, _0.pos, _0.fnm, _0.fdt, _0.doc, _0.tim, _0.fdx, _0_nrm.cfs, _0.tip, _0_nrm.cfe]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1355296550414/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@12b312b3; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[_0.si, segments_3, _0.pos, _0.fnm, _0.fdt, _0.doc, _0.tim, _0.fdx, _0_nrm.cfs, _0.tip, _0_nrm.cfe]
[junit4:junit4]   2> 11713 T197 C8 P42813 oasc.SolrDeletionPolicy.updateCommits newest commit = 3
[junit4:junit4]   2> 11718 T197 C8 P42813 oass.SolrIndexSearcher.<init> Opening Searcher@1f561f56 realtime
[junit4:junit4]   2> 11720 T197 C8 P42813 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 11721 T197 C8 P42813 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 11722 T197 C8 P42813 /update {softCommit=false&commit_end_point=true&commit=true&version=2&waitSearcher=true&wt=javabin&openSearcher=false} {commit=} 0 186
[junit4:junit4]   2> 11734 T237 C7 P35440 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 11734 T237 C7 P35440 oascsi.HttpClientUtil.createClient Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
[junit4:junit4]   2> 11740 T237 C7 P35440 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 11744 T200 C8 P42813 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 11745 T200 C8 P42813 REQ /replication {version=2&command=indexversion&qt=/replication&wt=javabin} status=0 QTime=2 
[junit4:junit4]   2> 11747 T237 C7 P35440 oash.SnapPuller.fetchLatestIndex Master's generation: 3
[junit4:junit4]   2> 11747 T237 C7 P35440 oash.SnapPuller.fetchLatestIndex Slave's generation: 2
[junit4:junit4]   2> 11748 T237 C7 P35440 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 11756 T197 C8 P42813 REQ /replication {generation=3&version=2&command=filelist&qt=/replication&wt=javabin} status=0 QTime=6 
[junit4:junit4]   2> 11761 T237 C7 P35440 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 11
[junit4:junit4]   2> 11766 T237 C7 P35440 oash.SnapPuller.fetchLatestIndex Starting download to ./org.apache.solr.cloud.BasicDistributedZk2Test-1355296550414/jetty3/index.20121212081602170 fullCopy=true
[junit4:junit4]   2> 11896 T198 C8 P42813 REQ /replication {qt=/replication&checksum=true&generation=3&command=filecontent&file=_0.fnm&wt=filestream} status=0 QTime=1 
[junit4:junit4]   2> 11905 T199 C8 P42813 REQ /replication {qt=/replication&checksum=true&generation=3&command=filecontent&file=_0_nrm.cfe&wt=filestream} status=0 QTime=1 
[junit4:junit4]   2> 11910 T200 C8 P42813 REQ /replication {qt=/replication&checksum=true&generation=3&command=filecontent&file=_0.si&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 11917 T197 C8 P42813 REQ /replication {qt=/replication&checksum=true&generation=3&command=filecontent&file=segments_3&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 11924 T198 C8 P42813 REQ /replication {qt=/replication&checksum=true&generation=3&command=filecontent&file=_0.pos&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 11931 T199 C8 P42813 REQ /replication {qt=/replication&checksum=true&generation=3&command=filecontent&file=_0.fdt&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 11936 T200 C8 P42813 REQ /replication {qt=/replication&checksum=true&generation=3&command=filecontent&file=_0.tim&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 11942 T197 C8 P42813 REQ /replication {qt=/replication&checksum=true&generation=3&command=filecontent&file=_0.doc&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 11948 T198 C8 P42813 REQ /replication {qt=/replication&checksum=true&generation=3&command=filecontent&file=_0_nrm.cfs&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 11954 T199 C8 P42813 REQ /replication {qt=/replication&checksum=true&generation=3&command=filecontent&file=_0.fdx&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 11959 T200 C8 P42813 REQ /replication {qt=/replication&checksum=true&generation=3&command=filecontent&file=_0.tip&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 11962 T237 C7 P35440 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 12029 T237 C7 P35440 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20121212081602170
[junit4:junit4]   2> 12035 T237 C7 P35440 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:

[...truncated too long message...]

unit4]   1>                 "roles":null,
[junit4:junit4]   1>                 "collection":"collection1",
[junit4:junit4]   1>                 "shard":"shard1",
[junit4:junit4]   1>                 "core":"collection1"}}},
[junit4:junit4]   1>           "shard2":{
[junit4:junit4]   1>             "range":"0-7fffffff",
[junit4:junit4]   1>             "replicas":{
[junit4:junit4]   1>               "127.0.0.1:53274_solr_collection1":{
[junit4:junit4]   1>                 "base_url":"http://127.0.0.1:53274/solr",
[junit4:junit4]   1>                 "state":"active",
[junit4:junit4]   1>                 "node_name":"127.0.0.1:53274_solr",
[junit4:junit4]   1>                 "roles":null,
[junit4:junit4]   1>                 "collection":"collection1",
[junit4:junit4]   1>                 "shard":"shard2",
[junit4:junit4]   1>                 "core":"collection1",
[junit4:junit4]   1>                 "leader":"true"},
[junit4:junit4]   1>               "127.0.0.1:38973_solr_collection1":{
[junit4:junit4]   1>                 "base_url":"http://127.0.0.1:38973/solr",
[junit4:junit4]   1>                 "state":"active",
[junit4:junit4]   1>                 "node_name":"127.0.0.1:38973_solr",
[junit4:junit4]   1>                 "roles":null,
[junit4:junit4]   1>                 "collection":"collection1",
[junit4:junit4]   1>                 "shard":"shard2",
[junit4:junit4]   1>                 "core":"collection1"}}}}}
[junit4:junit4]   1>  /zookeeper (1)
[junit4:junit4]   1>  DATA:
[junit4:junit4]   1>      
[junit4:junit4]   1> 
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=BasicDistributedZkTest -Dtests.method=testDistribSearch -Dtests.seed=1D016F7364EF4507 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=mk_MK -Dtests.timezone=America/Panama -Dtests.file.encoding=UTF-8
[junit4:junit4] ERROR    206s J0 | BasicDistributedZkTest.testDistribSearch <<<
[junit4:junit4]    > Throwable #1: org.apache.solr.common.SolrException: Server at http://127.0.0.1:38973/solr returned non ok status:500, message:Server Error
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([1D016F7364EF4507:9CE7E16B13B0253B]:0)
[junit4:junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:372)
[junit4:junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
[junit4:junit4]    > 	at org.apache.solr.client.solrj.request.CoreAdminRequest.process(CoreAdminRequest.java:429)
[junit4:junit4]    > 	at org.apache.solr.client.solrj.request.CoreAdminRequest.getStatus(CoreAdminRequest.java:472)
[junit4:junit4]    > 	at org.apache.solr.cloud.BasicDistributedZkTest.collectStartTimes(BasicDistributedZkTest.java:959)
[junit4:junit4]    > 	at org.apache.solr.cloud.BasicDistributedZkTest.testCollectionsAPI(BasicDistributedZkTest.java:795)
[junit4:junit4]    > 	at org.apache.solr.cloud.BasicDistributedZkTest.doTest(BasicDistributedZkTest.java:343)
[junit4:junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:60)
[junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:37)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:611)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:738)
[junit4:junit4]   2> 205562 T579 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> NOTE: test params are: codec=Lucene40, sim=DefaultSimilarity, locale=mk_MK, timezone=America/Panama
[junit4:junit4]   2> NOTE: Linux 3.2.0-34-generic x86/IBM Corporation 1.6.0 (32-bit)/cpus=8,threads=1,free=173834288,total=507815936
[junit4:junit4]   2> NOTE: All tests run in this JVM: [TestLuceneMatchVersion, TestJoin, TestElisionMultitermQuery, DistanceFunctionTest, TestSystemIdResolver, TestIndexingPerformance, DefaultValueUpdateProcessorTest, TestDefaultSimilarityFactory, CacheHeaderTest, TestFaceting, AnalysisAfterCoreReloadTest, BasicDistributedZk2Test, LoggingHandlerTest, BinaryUpdateRequestHandlerTest, TestXIncludeConfig, TestFuzzyAnalyzedSuggestions, RequestHandlersTest, SuggesterFSTTest, SolrRequestParserTest, TestLMDirichletSimilarityFactory, SortByFunctionTest, TestDocumentBuilder, AutoCommitTest, SyncSliceTest, UniqFieldsUpdateProcessorFactoryTest, BasicDistributedZkTest]
[junit4:junit4] Completed on J0 in 205.69s, 1 test, 1 error <<< FAILURES!

[...truncated 113 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:365: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:178: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:438: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1171: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:835: There were test failures: 239 suites, 994 tests, 1 error, 2 failures, 7 ignored (2 assumptions)

Total time: 49 minutes 16 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 32bit/ibm-j9-jdk6 
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-4.x-Linux (32bit/jdk1.7.0_09) - Build # 3177 - Still Failing!

Posted by Policeman Jenkins Server <je...@sd-datasolutions.de>.
Build: http://jenkins.sd-datasolutions.de/job/Lucene-Solr-4.x-Linux/3177/
Java: 32bit/jdk1.7.0_09 -server -XX:+UseConcMarkSweepGC

3 tests failed.
FAILED:  org.apache.solr.cloud.SyncSliceTest.testDistribSearch

Error Message:
There are still nodes recoverying - waited for 540 seconds

Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 540 seconds
	at __randomizedtesting.SeedInfo.seed([705D8AC5215FB46A:F1BB04DD5600D456]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:165)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:115)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:110)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:563)
	at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:224)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:601)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)


FAILED:  org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch

Error Message:
There are still nodes recoverying - waited for 540 seconds

Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 540 seconds
	at __randomizedtesting.SeedInfo.seed([705D8AC5215FB46A:F1BB04DD5600D456]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:165)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:115)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:110)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:563)
	at org.apache.solr.cloud.BasicDistributedZk2Test.brindDownShardIndexSomeDocsAndRecover(BasicDistributedZk2Test.java:321)
	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:83)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:601)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)


FAILED:  org.apache.solr.cloud.BasicDistributedZkTest.testDistribSearch

Error Message:
Server at http://127.0.0.1:43448/solr returned non ok status:500, message:Server Error

Stack Trace:
org.apache.solr.common.SolrException: Server at http://127.0.0.1:43448/solr returned non ok status:500, message:Server Error
	at __randomizedtesting.SeedInfo.seed([705D8AC5215FB46A:F1BB04DD5600D456]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:372)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
	at org.apache.solr.client.solrj.request.CoreAdminRequest.process(CoreAdminRequest.java:429)
	at org.apache.solr.client.solrj.request.CoreAdminRequest.getStatus(CoreAdminRequest.java:472)
	at org.apache.solr.cloud.BasicDistributedZkTest.collectStartTimes(BasicDistributedZkTest.java:959)
	at org.apache.solr.cloud.BasicDistributedZkTest.testCollectionsAPI(BasicDistributedZkTest.java:795)
	at org.apache.solr.cloud.BasicDistributedZkTest.doTest(BasicDistributedZkTest.java:343)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:601)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)




Build Log:
[...truncated 8728 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZkTest
[junit4:junit4]   2> 7 T392 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZkTest-1355292751915
[junit4:junit4]   2> 12 T392 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 15 T393 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 44 T393 oaz.Environment.logEnv Server environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
[junit4:junit4]   2> 44 T393 oaz.Environment.logEnv Server environment:host.name=serv1
[junit4:junit4]   2> 44 T393 oaz.Environment.logEnv Server environment:java.version=1.7.0_09
[junit4:junit4]   2> 44 T393 oaz.Environment.logEnv Server environment:java.vendor=Oracle Corporation
[junit4:junit4]   2> 44 T393 oaz.Environment.logEnv Server environment:java.home=/mnt/ssd/jenkins/tools/java/32bit/jdk1.7.0_09/jre
[junit4:junit4]   2> 44 T393 oaz.Environment.logEnv Server environment:java.class.path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/test:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/codecs/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-solrj/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/common/lucene-analyzers-common-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/highlighter/lucene-highlighter-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/memory/lucene-memory-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/misc/lucene-misc-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/spatial/lucene-spatial-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/suggest/lucene-suggest-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/grouping/lucene-grouping-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queries/lucene-queries-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queryparser/lucene-queryparser-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/cglib-nodep-2.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-cli-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-codec-1.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-fileupload-1.2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-lang-2.6.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/easymock-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/guava-13.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/javax.servlet-api-3.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/metrics-core-2.1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/objenesis-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/spatial4j-0.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/commons-io-2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpclient-4.1.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpcore-4.1.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpmime-4.1.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/jcl-over-slf4j-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/log4j-over-slf4j-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-api-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-jdk14-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/wstx-asl-3.2.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/zookeeper-3.4.5.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-continuation-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-deploy-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-http-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-io-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-jmx-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-security-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-server-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-servlet-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-util-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-webapp-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-xml-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/servlet-api-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/hsqldb-1.8.0.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/junit-4.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/randomizedtesting-runner-2.0.5.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-launcher.jar:/var/lib/jenkins/.ant/lib/ivy-2.2.0.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jdepend.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-netrexx.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-antlr.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-commons-net.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-javamail.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-regexp.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jsch.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-xalan2.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-junit4.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jmf.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-junit.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-bcel.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jai.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-commons-logging.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-resolver.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-oro.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-swing.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-bsf.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-log4j.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-testutil.jar:/mnt/ssd/jenkins/tools/java/32bit/jdk1.7.0_09/lib/tools.jar:/var/lib/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.0.5.jar
[junit4:junit4]   2> 45 T393 oaz.Environment.logEnv Server environment:java.library.path=/usr/lib/jvm/j2sdk1.6-sun/jre/lib/amd64/server:/usr/lib/jvm/j2sdk1.6-sun/jre/lib/amd64:/usr/lib/jvm/j2sdk1.6-sun/jre/../lib/amd64:/usr/java/packages/lib/i386:/lib:/usr/lib
[junit4:junit4]   2> 45 T393 oaz.Environment.logEnv Server environment:java.io.tmpdir=.
[junit4:junit4]   2> 45 T393 oaz.Environment.logEnv Server environment:java.compiler=<NA>
[junit4:junit4]   2> 45 T393 oaz.Environment.logEnv Server environment:os.name=Linux
[junit4:junit4]   2> 45 T393 oaz.Environment.logEnv Server environment:os.arch=i386
[junit4:junit4]   2> 45 T393 oaz.Environment.logEnv Server environment:os.version=3.2.0-34-generic
[junit4:junit4]   2> 45 T393 oaz.Environment.logEnv Server environment:user.name=jenkins
[junit4:junit4]   2> 46 T393 oaz.Environment.logEnv Server environment:user.home=/var/lib/jenkins
[junit4:junit4]   2> 46 T393 oaz.Environment.logEnv Server environment:user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 61 T393 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 61 T393 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4]   2> 61 T393 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4]   2> 73 T393 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 97 T393 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355292751915/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4]   2> 115 T392 oasc.ZkTestServer.run start zk server on port:50326
[junit4:junit4]   2> 141 T392 oaz.Environment.logEnv Client environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
[junit4:junit4]   2> 141 T392 oaz.Environment.logEnv Client environment:host.name=serv1
[junit4:junit4]   2> 142 T392 oaz.Environment.logEnv Client environment:java.version=1.7.0_09
[junit4:junit4]   2> 142 T392 oaz.Environment.logEnv Client environment:java.vendor=Oracle Corporation
[junit4:junit4]   2> 142 T392 oaz.Environment.logEnv Client environment:java.home=/mnt/ssd/jenkins/tools/java/32bit/jdk1.7.0_09/jre
[junit4:junit4]   2> 142 T392 oaz.Environment.logEnv Client environment:java.class.path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/test:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/codecs/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-solrj/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/common/lucene-analyzers-common-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/highlighter/lucene-highlighter-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/memory/lucene-memory-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/misc/lucene-misc-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/spatial/lucene-spatial-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/suggest/lucene-suggest-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/grouping/lucene-grouping-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queries/lucene-queries-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queryparser/lucene-queryparser-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/cglib-nodep-2.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-cli-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-codec-1.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-fileupload-1.2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-lang-2.6.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/easymock-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/guava-13.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/javax.servlet-api-3.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/metrics-core-2.1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/objenesis-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/spatial4j-0.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/commons-io-2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpclient-4.1.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpcore-4.1.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpmime-4.1.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/jcl-over-slf4j-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/log4j-over-slf4j-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-api-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-jdk14-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/wstx-asl-3.2.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/zookeeper-3.4.5.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-continuation-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-deploy-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-http-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-io-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-jmx-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-security-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-server-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-servlet-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-util-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-webapp-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-xml-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/servlet-api-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/hsqldb-1.8.0.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/junit-4.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/randomizedtesting-runner-2.0.5.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-launcher.jar:/var/lib/jenkins/.ant/lib/ivy-2.2.0.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jdepend.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-netrexx.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-antlr.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-commons-net.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-javamail.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-regexp.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jsch.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-xalan2.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-junit4.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jmf.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-junit.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-bcel.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jai.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-commons-logging.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-resolver.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-oro.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-swing.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-bsf.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-log4j.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-testutil.jar:/mnt/ssd/jenkins/tools/java/32bit/jdk1.7.0_09/lib/tools.jar:/var/lib/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.0.5.jar
[junit4:junit4]   2> 144 T392 oaz.Environment.logEnv Client environment:java.library.path=/usr/lib/jvm/j2sdk1.6-sun/jre/lib/amd64/server:/usr/lib/jvm/j2sdk1.6-sun/jre/lib/amd64:/usr/lib/jvm/j2sdk1.6-sun/jre/../lib/amd64:/usr/java/packages/lib/i386:/lib:/usr/lib
[junit4:junit4]   2> 144 T392 oaz.Environment.logEnv Client environment:java.io.tmpdir=.
[junit4:junit4]   2> 145 T392 oaz.Environment.logEnv Client environment:java.compiler=<NA>
[junit4:junit4]   2> 146 T392 oaz.Environment.logEnv Client environment:os.name=Linux
[junit4:junit4]   2> 146 T392 oaz.Environment.logEnv Client environment:os.arch=i386
[junit4:junit4]   2> 147 T392 oaz.Environment.logEnv Client environment:os.version=3.2.0-34-generic
[junit4:junit4]   2> 147 T392 oaz.Environment.logEnv Client environment:user.name=jenkins
[junit4:junit4]   2> 148 T392 oaz.Environment.logEnv Client environment:user.home=/var/lib/jenkins
[junit4:junit4]   2> 149 T392 oaz.Environment.logEnv Client environment:user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 152 T392 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50326 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@18b20c1
[junit4:junit4]   2> 184 T392 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 187 T398 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:50326. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 191 T398 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:50326, initiating session
[junit4:junit4]   2> 363 T394 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:45236
[junit4:junit4]   2> 379 T394 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:45236
[junit4:junit4]   2> 386 T396 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 476 T396 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8dbe388e0000 with negotiated timeout 10000 for client /127.0.0.1:45236
[junit4:junit4]   2> 477 T398 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:50326, sessionid = 0x13b8dbe388e0000, negotiated timeout = 10000
[junit4:junit4]   2> 480 T399 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@18b20c1 name:ZooKeeperConnection Watcher:127.0.0.1:50326 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 481 T392 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 483 T392 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 538 T397 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8dbe388e0000
[junit4:junit4]   2> 539 T399 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 539 T392 oaz.ZooKeeper.close Session: 0x13b8dbe388e0000 closed
[junit4:junit4]   2> 541 T394 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:45236 which had sessionid 0x13b8dbe388e0000
[junit4:junit4]   2> 541 T392 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50326/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@16f214d
[junit4:junit4]   2> 543 T400 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:50326. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 543 T392 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 544 T400 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:50326, initiating session
[junit4:junit4]   2> 544 T394 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:45237
[junit4:junit4]   2> 544 T394 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:45237
[junit4:junit4]   2> 546 T396 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8dbe388e0001 with negotiated timeout 10000 for client /127.0.0.1:45237
[junit4:junit4]   2> 546 T400 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:50326, sessionid = 0x13b8dbe388e0001, negotiated timeout = 10000
[junit4:junit4]   2> 546 T401 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@16f214d name:ZooKeeperConnection Watcher:127.0.0.1:50326/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 546 T392 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 553 T392 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 561 T392 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 567 T392 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 571 T392 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 578 T392 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 579 T392 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 591 T392 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 593 T392 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 604 T392 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 605 T392 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 620 T392 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 620 T392 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 624 T392 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 624 T392 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 627 T392 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 628 T392 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 631 T392 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 632 T392 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 635 T392 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 636 T392 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 639 T392 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 640 T392 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 643 T392 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 644 T392 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 647 T397 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8dbe388e0001
[junit4:junit4]   2> 648 T401 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 648 T394 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:45237 which had sessionid 0x13b8dbe388e0001
[junit4:junit4]   2> 648 T392 oaz.ZooKeeper.close Session: 0x13b8dbe388e0001 closed
[junit4:junit4]   2> 861 T392 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 987 T392 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:52706
[junit4:junit4]   2> 1000 T392 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 1002 T392 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355292752556
[junit4:junit4]   2> 1002 T392 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355292752556/'
[junit4:junit4]   2> 1025 T392 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 1026 T392 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 1026 T392 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355292752556
[junit4:junit4]   2> 1027 T392 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355292752556/solr.xml
[junit4:junit4]   2> 1027 T392 oasc.CoreContainer.<init> New CoreContainer 5658787
[junit4:junit4]   2> 1028 T392 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355292752556/'
[junit4:junit4]   2> 1028 T392 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355292752556/'
[junit4:junit4]   2> 1054 T392 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 1064 T392 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:50326/solr
[junit4:junit4]   2> 1071 T392 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 1071 T392 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50326 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1e7b905
[junit4:junit4]   2> 1072 T392 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 1073 T412 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:50326. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 1074 T412 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:50326, initiating session
[junit4:junit4]   2> 1074 T394 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:45238
[junit4:junit4]   2> 1075 T394 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:45238
[junit4:junit4]   2> 1076 T396 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8dbe388e0002 with negotiated timeout 20000 for client /127.0.0.1:45238
[junit4:junit4]   2> 1076 T412 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:50326, sessionid = 0x13b8dbe388e0002, negotiated timeout = 20000
[junit4:junit4]   2> 1077 T413 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e7b905 name:ZooKeeperConnection Watcher:127.0.0.1:50326 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 1077 T392 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 1078 T397 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8dbe388e0002
[junit4:junit4]   2> 1079 T413 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 1079 T394 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:45238 which had sessionid 0x13b8dbe388e0002
[junit4:junit4]   2> 1079 T392 oaz.ZooKeeper.close Session: 0x13b8dbe388e0002 closed
[junit4:junit4]   2> 1081 T392 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50326/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@57677f
[junit4:junit4]   2> 1082 T414 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:50326. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 1082 T392 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 1082 T414 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:50326, initiating session
[junit4:junit4]   2> 1083 T394 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:45239
[junit4:junit4]   2> 1083 T394 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:45239
[junit4:junit4]   2> 1084 T396 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8dbe388e0003 with negotiated timeout 8000 for client /127.0.0.1:45239
[junit4:junit4]   2> 1084 T414 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:50326, sessionid = 0x13b8dbe388e0003, negotiated timeout = 8000
[junit4:junit4]   2> 1084 T415 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@57677f name:ZooKeeperConnection Watcher:127.0.0.1:50326/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 1085 T392 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 1092 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8dbe388e0003 type:create cxid:0x2 zxid:0x1b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1096 T392 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 1098 T392 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52706_solr
[junit4:junit4]   2> 1101 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8dbe388e0003 type:delete cxid:0x7 zxid:0x1d txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:52706_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:52706_solr
[junit4:junit4]   2> 1102 T392 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52706_solr
[junit4:junit4]   2> 1105 T392 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 1105 T392 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 1106 T392 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 1106 T392 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 1106 T392 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 1107 T392 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 1107 T392 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 1108 T392 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 1109 T392 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 1109 T392 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 1115 T392 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 1127 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8dbe388e0003 type:delete cxid:0x15 zxid:0x22 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 1128 T392 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 1131 T392 oasc.Overseer.start Overseer (id=88820465795989507-127.0.0.1:52706_solr-n_0000000000) starting
[junit4:junit4]   2> 1138 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8dbe388e0003 type:create cxid:0x1a zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1145 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8dbe388e0003 type:create cxid:0x1b zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1146 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8dbe388e0003 type:create cxid:0x1c zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1150 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8dbe388e0003 type:create cxid:0x1d zxid:0x27 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1151 T417 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
[junit4:junit4]   2> 1151 T392 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 1154 T392 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 1161 T416 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 1177 T418 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355292752556/collection1
[junit4:junit4]   2> 1178 T418 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4]   2> 1178 T418 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 1179 T418 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4]   2> 1180 T418 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355292752556/collection1/'
[junit4:junit4]   2> 1181 T418 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355292752556/collection1/lib/README' to classloader
[junit4:junit4]   2> 1181 T418 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355292752556/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 1233 T418 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 1318 T418 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 1319 T418 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 1325 T418 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 1715 T418 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 1722 T418 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 1724 T418 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 1745 T418 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1750 T418 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1754 T418 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1757 T418 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1759 T418 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355292752556/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355292751915/control/data/
[junit4:junit4]   2> 1760 T418 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@d17b70
[junit4:junit4]   2> 1772 T418 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355292751915/control/data/index/
[junit4:junit4]   2> 1772 T418 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355292751915/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 1773 T418 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355292751915/control/data/index forceNew:false
[junit4:junit4]   2> 1800 T418 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355292751915/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@e19eb5; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 1801 T418 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 1801 T418 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 1802 T418 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 1802 T418 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 1803 T418 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 1803 T418 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 1803 T418 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 1803 T418 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 1804 T418 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 1804 T418 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 1805 T418 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 1806 T418 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 1806 T418 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 1807 T418 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 1807 T418 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 1808 T418 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 1808 T418 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 1810 T418 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 1812 T418 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1814 T418 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1814 T418 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1815 T418 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1816 T418 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1817 T418 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1818 T418 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1819 T418 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 1820 T418 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 1823 T418 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 1826 T418 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 1827 T418 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 1830 T418 oass.SolrIndexSearcher.<init> Opening Searcher@6340c6 main
[junit4:junit4]   2> 1830 T418 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 1831 T418 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 1831 T418 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 1832 T418 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 1836 T418 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 1858 T419 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6340c6 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 1862 T418 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 1863 T418 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 1863 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8dbe388e0003 type:create cxid:0x53 zxid:0x2a txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 1866 T418 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 1866 T418 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:52706/solr shardId:control_shard
[junit4:junit4]   2> 1870 T418 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4]   2> 1874 T418 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/control_shard/election
[junit4:junit4]   2> 1881 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8dbe388e0003 type:delete cxid:0x62 zxid:0x31 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4]   2> 1882 T418 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 1882 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8dbe388e0003 type:create cxid:0x63 zxid:0x32 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2171 T416 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2172 T416 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":"control_shard",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:52706_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:52706/solr"}
[junit4:junit4]   2> 2180 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8dbe388e0003 type:create cxid:0x6a zxid:0x34 txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 2201 T415 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 2385 T418 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 2386 T418 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 2386 T418 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:52706/solr/collection1/
[junit4:junit4]   2> 2387 T418 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 2387 T418 oasc.SyncStrategy.syncToMe http://127.0.0.1:52706/solr/collection1/ has no replicas
[junit4:junit4]   2> 2387 T418 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:52706/solr/collection1/
[junit4:junit4]   2> 2388 T418 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/control_shard
[junit4:junit4]   2> 2397 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8dbe388e0003 type:create cxid:0x89 zxid:0x3f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2713 T416 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2721 T415 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 2751 T418 oasc.ZkController.register We are http://127.0.0.1:52706/solr/collection1/ and leader is http://127.0.0.1:52706/solr/collection1/
[junit4:junit4]   2> 2752 T418 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:52706/solr
[junit4:junit4]   2> 2752 T418 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 2752 T418 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 2753 T418 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 2756 T418 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2758 T392 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 2759 T392 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 2778 T392 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 2833 T392 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 2836 T392 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:44966
[junit4:junit4]   2> 2836 T392 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 2837 T392 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355292754690
[junit4:junit4]   2> 2837 T392 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355292754690/'
[junit4:junit4]   2> 2849 T392 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 2850 T392 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 2850 T392 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355292754690
[junit4:junit4]   2> 2850 T392 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355292754690/solr.xml
[junit4:junit4]   2> 2851 T392 oasc.CoreContainer.<init> New CoreContainer 27138147
[junit4:junit4]   2> 2851 T392 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355292754690/'
[junit4:junit4]   2> 2852 T392 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355292754690/'
[junit4:junit4]   2> 2864 T392 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 2876 T392 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:50326/solr
[junit4:junit4]   2> 2877 T392 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 2877 T392 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50326 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1a60b70
[junit4:junit4]   2> 2878 T429 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:50326. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 2878 T392 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2879 T429 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:50326, initiating session
[junit4:junit4]   2> 2879 T394 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:45242
[junit4:junit4]   2> 2879 T394 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:45242
[junit4:junit4]   2> 2881 T396 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8dbe388e0004 with negotiated timeout 20000 for client /127.0.0.1:45242
[junit4:junit4]   2> 2881 T429 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:50326, sessionid = 0x13b8dbe388e0004, negotiated timeout = 20000
[junit4:junit4]   2> 2881 T430 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1a60b70 name:ZooKeeperConnection Watcher:127.0.0.1:50326 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2882 T392 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2883 T397 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8dbe388e0004
[junit4:junit4]   2> 2883 T430 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 2884 T394 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:45242 which had sessionid 0x13b8dbe388e0004
[junit4:junit4]   2> 2883 T392 oaz.ZooKeeper.close Session: 0x13b8dbe388e0004 closed
[junit4:junit4]   2> 2884 T392 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50326/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@aad59a
[junit4:junit4]   2> 2885 T431 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:50326. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 2885 T392 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2885 T431 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:50326, initiating session
[junit4:junit4]   2> 2885 T394 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:45243
[junit4:junit4]   2> 2886 T394 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:45243
[junit4:junit4]   2> 2886 T396 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8dbe388e0005 with negotiated timeout 8000 for client /127.0.0.1:45243
[junit4:junit4]   2> 2886 T431 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:50326, sessionid = 0x13b8dbe388e0005, negotiated timeout = 8000
[junit4:junit4]   2> 2886 T432 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@aad59a name:ZooKeeperConnection Watcher:127.0.0.1:50326/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2886 T392 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2887 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8dbe388e0005 type:create cxid:0x1 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2888 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8dbe388e0005 type:create cxid:0x2 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2889 T392 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44966_solr
[junit4:junit4]   2> 2890 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8dbe388e0005 type:delete cxid:0x4 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:44966_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:44966_solr
[junit4:junit4]   2> 2890 T392 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:44966_solr
[junit4:junit4]   2> 2892 T415 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 2893 T415 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 2893 T392 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 2893 T392 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 2894 T392 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 2894 T392 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 2894 T392 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 2895 T392 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 2895 T392 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 2895 T392 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 2896 T392 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 2896 T392 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 2907 T392 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 2918 T433 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355292754690/collection1
[junit4:junit4]   2> 2918 T433 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 2919 T433 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 2920 T433 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 2922 T433 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355292754690/collection1/'
[junit4:junit4]   2> 2923 T433 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty1-1355292754690/collection1/lib/README' to classloader
[junit4:junit4]   2> 2923 T433 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty1-1355292754690/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 2992 T433 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 3053 T433 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 3054 T433 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 3063 T433 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 3241 T416 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3242 T416 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":"control_shard",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:52706_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:52706/solr"}
[junit4:junit4]   2> 3260 T432 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3261 T415 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3627 T433 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 3633 T433 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 3635 T433 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 3651 T433 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 3655 T433 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 3667 T433 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 3669 T433 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 3671 T433 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355292754690/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355292751915/jetty1/
[junit4:junit4]   2> 3671 T433 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@d17b70
[junit4:junit4]   2> 3672 T433 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355292751915/jetty1/index/
[junit4:junit4]   2> 3673 T433 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355292751915/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 3674 T433 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355292751915/jetty1/index forceNew:false
[junit4:junit4]   2> 3702 T433 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355292751915/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@daf8bd; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 3703 T433 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 3704 T433 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 3708 T433 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 3708 T433 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 3709 T433 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 3709 T433 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 3711 T433 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 3711 T433 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 3712 T433 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 3714 T433 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 3716 T433 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 3717 T433 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 3718 T433 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 3719 T433 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 3721 T433 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 3721 T433 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 3721 T433 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 3723 T433 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 3724 T433 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3726 T433 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3728 T433 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3729 T433 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3730 T433 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3731 T433 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3733 T433 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3734 T433 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 3735 T433 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 3740 T433 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 3744 T433 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 3748 T433 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 3753 T433 oass.SolrIndexSearcher.<init> Opening Searcher@a16d01 main
[junit4:junit4]   2> 3753 T433 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 3754 T433 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 3754 T433 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 3755 T433 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 3762 T433 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 3799 T434 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@a16d01 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 3804 T433 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 3804 T433 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 4279 T416 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4280 T416 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:44966_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:44966/solr"}
[junit4:junit4]   2> 4280 T416 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4]   2> 4284 T416 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 4292 T432 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 4292 T415 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 4305 T433 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 4306 T433 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:44966/solr shardId:shard1
[junit4:junit4]   2> 4307 T433 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 4322 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8dbe388e0005 type:delete cxid:0x45 zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 4322 T433 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 4323 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8dbe388e0005 type:create cxid:0x46 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4324 T433 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 4325 T433 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 4325 T433 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:44966/solr/collection1/
[junit4:junit4]   2> 4325 T433 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 4325 T433 oasc.SyncStrategy.syncToMe http://127.0.0.1:44966/solr/collection1/ has no replicas
[junit4:junit4]   2> 4325 T433 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:44966/solr/collection1/
[junit4:junit4]   2> 4325 T433 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 4330 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8dbe388e0005 type:create cxid:0x50 zxid:0x60 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4804 T416 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4838 T415 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 4838 T432 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 4883 T433 oasc.ZkController.register We are http://127.0.0.1:44966/solr/collection1/ and leader is http://127.0.0.1:44966/solr/collection1/
[junit4:junit4]   2> 4884 T433 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:44966/solr
[junit4:junit4]   2> 4884 T433 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 4884 T433 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 4884 T433 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 4886 T433 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4887 T392 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 4887 T392 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 4888 T392 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 4939 T392 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 4941 T392 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:46571
[junit4:junit4]   2> 4942 T392 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 4942 T392 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355292756798
[junit4:junit4]   2> 4943 T392 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355292756798/'
[junit4:junit4]   2> 4954 T392 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 4955 T392 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 4955 T392 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355292756798
[junit4:junit4]   2> 4956 T392 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355292756798/solr.xml
[junit4:junit4]   2> 4956 T392 oasc.CoreContainer.<init> New CoreContainer 13038722
[junit4:junit4]   2> 4956 T392 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355292756798/'
[junit4:junit4]   2> 4957 T392 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355292756798/'
[junit4:junit4]   2> 4974 T392 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 4983 T392 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:50326/solr
[junit4:junit4]   2> 4983 T392 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 4984 T392 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50326 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1dda0fd
[junit4:junit4]   2> 4984 T392 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4985 T444 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:50326. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 4985 T444 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:50326, initiating session
[junit4:junit4]   2> 4986 T394 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:45249
[junit4:junit4]   2> 4986 T394 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:45249
[junit4:junit4]   2> 4986 T396 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8dbe388e0006 with negotiated timeout 20000 for client /127.0.0.1:45249
[junit4:junit4]   2> 4987 T444 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:50326, sessionid = 0x13b8dbe388e0006, negotiated timeout = 20000
[junit4:junit4]   2> 4987 T445 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1dda0fd name:ZooKeeperConnection Watcher:127.0.0.1:50326 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4987 T392 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4988 T397 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8dbe388e0006
[junit4:junit4]   2> 4989 T445 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 4989 T394 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:45249 which had sessionid 0x13b8dbe388e0006
[junit4:junit4]   2> 4989 T392 oaz.ZooKeeper.close Session: 0x13b8dbe388e0006 closed
[junit4:junit4]   2> 4989 T392 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50326/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@11bb5ba
[junit4:junit4]   2> 4990 T446 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:50326. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 4990 T392 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4991 T446 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:50326, initiating session
[junit4:junit4]   2> 4991 T394 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:45250
[junit4:junit4]   2> 4991 T394 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:45250
[junit4:junit4]   2> 4992 T396 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8dbe388e0007 with negotiated timeout 8000 for client /127.0.0.1:45250
[junit4:junit4]   2> 4992 T446 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:50326, sessionid = 0x13b8dbe388e0007, negotiated timeout = 8000
[junit4:junit4]   2> 4992 T447 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@11bb5ba name:ZooKeeperConnection Watcher:127.0.0.1:50326/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4992 T392 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4993 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8dbe388e0007 type:create cxid:0x1 zxid:0x6d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4994 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8dbe388e0007 type:create cxid:0x2 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4995 T392 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46571_solr
[junit4:junit4]   2> 4996 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8dbe388e0007 type:delete cxid:0x4 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:46571_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:46571_solr
[junit4:junit4]   2> 4996 T392 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:46571_solr
[junit4:junit4]   2> 5000 T415 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 5000 T432 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 5000 T415 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5000 T432 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5001 T392 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 5002 T392 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 5003 T392 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 5003 T392 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 5004 T392 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 5004 T392 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 5004 T392 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 5005 T392 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 5005 T392 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 5006 T392 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 5014 T392 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 5021 T448 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355292756798/collection1
[junit4:junit4]   2> 5021 T448 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 5022 T448 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 5022 T448 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 5024 T448 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355292756798/collection1/'
[junit4:junit4]   2> 5025 T448 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty2-1355292756798/collection1/lib/README' to classloader
[junit4:junit4]   2> 5025 T448 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty2-1355292756798/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 5059 T448 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 5104 T448 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 5105 T448 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 5111 T448 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 5347 T416 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5348 T416 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:44966_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:44966/solr"}
[junit4:junit4]   2> 5352 T432 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5352 T447 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5352 T415 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5485 T448 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 5494 T448 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 5496 T448 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 5512 T448 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5515 T448 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5518 T448 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5519 T448 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5521 T448 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355292756798/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355292751915/jetty2/
[junit4:junit4]   2> 5521 T448 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@d17b70
[junit4:junit4]   2> 5521 T448 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355292751915/jetty2/index/
[junit4:junit4]   2> 5522 T448 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355292751915/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 5522 T448 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355292751915/jetty2/index forceNew:false
[junit4:junit4]   2> 5619 T448 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355292751915/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1345817; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 5620 T448 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 5621 T448 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 5623 T448 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 5624 T448 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 5624 T448 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 5624 T448 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 5625 T448 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 5625 T448 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 5625 T448 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 5626 T448 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 5628 T448 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 5629 T448 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 5630 T448 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 5631 T448 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 5632 T448 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 5632 T448 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 5633 T448 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 5634 T448 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 5635 T448 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5636 T448 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5637 T448 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5638 T448 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5639 T448 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5640 T448 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5641 T448 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5641 T448 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 5642 T448 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 5644 T448 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 5645 T448 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 5647 T448 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 5648 T448 oass.SolrIndexSearcher.<init> Opening Searcher@1c52e9f main
[junit4:junit4]   2> 5649 T448 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 5649 T448 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 5649 T448 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 5650 T448 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 5653 T448 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 5681 T449 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1c52e9f main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 5690 T448 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 5690 T448 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 5860 T416 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5861 T416 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:46571_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:46571/solr"}
[junit4:junit4]   2> 5861 T416 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 5862 T416 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4]   2> 5869 T447 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5869 T432 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5869 T415 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 6193 T448 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 6193 T448 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:46571/solr shardId:shard2
[junit4:junit4]   2> 6195 T448 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4]   2> 6250 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8dbe388e0007 type:delete cxid:0x44 zxid:0x7e txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard2 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard2
[junit4:junit4]   2> 6251 T448 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 6252 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8dbe388e0007 type:create cxid:0x45 zxid:0x7f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6255 T448 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 6255 T448 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 6256 T448 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:46571/solr/collection1/
[junit4:junit4]   2> 6256 T448 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 6257 T448 oasc.SyncStrategy.syncToMe http://127.0.0.1:46571/solr/collection1/ has no replicas
[junit4:junit4]   2> 6257 T448 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:46571/solr/collection1/
[junit4:junit4]   2> 6257 T448 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4]   2> 6264 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8dbe388e0007 type:create cxid:0x4e zxid:0x82 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6378 T416 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6394 T432 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 6394 T447 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 6394 T415 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 6418 T448 oasc.ZkController.register We are http://127.0.0.1:46571/solr/collection1/ and leader is http://127.0.0.1:46571/solr/collection1/
[junit4:junit4]   2> 6418 T448 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:46571/solr
[junit4:junit4]   2> 6418 T448 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 6418 T448 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 6418 T448 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 6421 T448 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6421 T392 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 6422 T392 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 6422 T392 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 6482 T392 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 6484 T392 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:43448
[junit4:junit4]   2> 6485 T392 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 6485 T392 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355292758333
[junit4:junit4]   2> 6486 T392 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355292758333/'
[junit4:junit4]   2> 6497 T392 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 6497 T392 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 6498 T392 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355292758333
[junit4:junit4]   2> 6498 T392 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355292758333/solr.xml
[junit4:junit4]   2> 6498 T392 oasc.CoreContainer.<init> New CoreContainer 2286687
[junit4:junit4]   2> 6499 T392 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355292758333/'
[junit4:junit4]   2> 6499 T392 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355292758333/'
[junit4:junit4]   2> 6513 T392 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 6522 T392 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:50326/solr
[junit4:junit4]   2> 6523 T392 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 6523 T392 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50326 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@6469c9
[junit4:junit4]   2> 6524 T459 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:50326. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 6524 T392 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6525 T459 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:50326, initiating session
[junit4:junit4]   2> 6525 T394 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:45253
[junit4:junit4]   2> 6525 T394 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:45253
[junit4:junit4]   2> 6526 T396 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8dbe388e0008 with negotiated timeout 20000 for client /127.0.0.1:45253
[junit4:junit4]   2> 6526 T459 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:50326, sessionid = 0x13b8dbe388e0008, negotiated timeout = 20000
[junit4:junit4]   2> 6526 T460 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6469c9 name:ZooKeeperConnection Watcher:127.0.0.1:50326 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6526 T392 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6528 T397 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8dbe388e0008
[junit4:junit4]   2> 6528 T460 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 6528 T394 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:45253 which had sessionid 0x13b8dbe388e0008
[junit4:junit4]   2> 6528 T392 oaz.ZooKeeper.close Session: 0x13b8dbe388e0008 closed
[junit4:junit4]   2> 6529 T392 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50326/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@378186
[junit4:junit4]   2> 6530 T461 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:50326. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 6530 T392 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6530 T461 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:50326, initiating session
[junit4:junit4]   2> 6530 T394 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:45254
[junit4:junit4]   2> 6530 T394 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:45254
[junit4:junit4]   2> 6531 T396 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8dbe388e0009 with negotiated timeout 8000 for client /127.0.0.1:45254
[junit4:junit4]   2> 6531 T461 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:50326, sessionid = 0x13b8dbe388e0009, negotiated timeout = 8000
[junit4:junit4]   2> 6531 T462 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@378186 name:ZooKeeperConnection Watcher:127.0.0.1:50326/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6531 T392 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6532 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8dbe388e0009 type:create cxid:0x1 zxid:0x8f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6533 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8dbe388e0009 type:create cxid:0x2 zxid:0x90 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6534 T392 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43448_solr
[junit4:junit4]   2> 6534 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8dbe388e0009 type:delete cxid:0x4 zxid:0x91 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:43448_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:43448_solr
[junit4:junit4]   2> 6535 T392 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:43448_solr
[junit4:junit4]   2> 6537 T447 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 6537 T432 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 6538 T432 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6538 T415 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 6538 T415 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6538 T392 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 6539 T447 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 6538 T392 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 6539 T392 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 6539 T392 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 6540 T392 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 6540 T392 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 6541 T392 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 6541 T392 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 6542 T392 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 6542 T392 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 6551 T392 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 6559 T463 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355292758333/collection1
[junit4:junit4]   2> 6559 T463 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 6560 T463 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 6560 T463 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 6562 T463 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355292758333/collection1/'
[junit4:junit4]   2> 6563 T463 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty3-1355292758333/collection1/lib/README' to classloader
[junit4:junit4]   2> 6563 T463 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty3-1355292758333/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 6610 T463 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 6657 T463 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 6659 T463 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 6666 T463 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 6923 T416 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6924 T416 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:46571_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:46571/solr"}
[junit4:junit4]   2> 6931 T462 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6931 T432 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6932 T415 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6931 T447 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 7008 T463 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 7014 T463 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 7016 T463 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 7030 T463 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 7033 T463 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 7036 T463 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 7037 T463 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 7038 T463 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355292758333/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355292751915/jetty3/
[junit4:junit4]   2> 7038 T463 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@d17b70
[junit4:junit4]   2> 7039 T463 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355292751915/jetty3/index/
[junit4:junit4]   2> 7039 T463 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355292751915/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 7040 T463 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355292751915/jetty3/index forceNew:false
[junit4:junit4]   2> 7069 T463 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355292751915/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@15ea942; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 7070 T463 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 7070 T463 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 7071 T463 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 7072 T463 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 7072 T463 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 7072 T463 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 7073 T463 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 7073 T463 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 7073 T463 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 7074 T463 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 7074 T463 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 7075 T463 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 7076 T463 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 7076 T463 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 7077 T463 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 7077 T463 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 7077 T463 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 7078 T463 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 7078 T463 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7079 T463 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7079 T463 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7080 T463 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7081 T463 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7081 T463 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7082 T463 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7083 T463 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 7083 T463 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 7086 T463 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 7089 T463 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 7090 T463 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 7093 T463 oass.SolrIndexSearcher.<init> Opening Searcher@1d0780a main
[junit4:junit4]   2> 7093 T463 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 7094 T463 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 7094 T463 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 7095 T463 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 7099 T463 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 7216 T464 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1d0780a main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 7225 T463 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 7225 T463 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 7437 T416 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7442 T416 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:43448_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:43448/solr"}
[junit4:junit4]   2> 7442 T416 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 7443 T416 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 7450 T447 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 7450 T432 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 7450 T462 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 7450 T415 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 7727 T463 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 7728 T463 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:43448/solr shardId:shard1
[junit4:junit4]   2> 7731 T463 oasc.ZkController.register We are http://127.0.0.1:43448/solr/collection1/ and leader is http://127.0.0.1:44966/solr/collection1/
[junit4:junit4]   2> 7731 T463 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:43448/solr
[junit4:junit4]   2> 7732 T463 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 7732 T463 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C20 name=collection1 org.apache.solr.core.SolrCore@1bc8da2 url=http://127.0.0.1:43448/solr/collection1 node=127.0.0.1:43448_solr
[junit4:junit4]   2> 7735 T465 C20 P43448 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 7736 T465 C20 P43448 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 7736 T463 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7736 T465 C20 P43448 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 7736 T465 C20 P43448 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 7737 T392 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 7737 T465 C20 P43448 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:44966/solr/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 7737 T392 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 7738 T392 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 7742 T465 C20 P43448 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4]   2> 7748 T465 C20 P43448 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:43448/solr START replicas=[http://127.0.0.1:44966/solr/collection1/] nUpdates=100
[junit4:junit4]   2> 7752 T465 C20 P43448 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 7752 T465 C20 P43448 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 7752 T465 C20 P43448 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 7753 T465 C20 P43448 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 7802 T392 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 7805 T392 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:50894
[junit4:junit4]   2> 7806 T392 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 7806 T392 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355292759650
[junit4:junit4]   2> 7806 T392 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355292759650/'
[junit4:junit4]   2> 7818 T392 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 7819 T392 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 7819 T392 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355292759650
[junit4:junit4]   2> 7819 T392 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355292759650/solr.xml
[junit4:junit4]   2> 7820 T392 oasc.CoreContainer.<init> New CoreContainer 24643318
[junit4:junit4]   2> 7820 T392 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355292759650/'
[junit4:junit4]   2> 7820 T392 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355292759650/'
[junit4:junit4]   2> 7834 T392 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 7848 T392 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:50326/solr
[junit4:junit4]   2> 7848 T392 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 7849 T392 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50326 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@254d78
[junit4:junit4]   2> 7850 T476 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:50326. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 7849 T392 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 7850 T476 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:50326, initiating session
[junit4:junit4]   2> 7850 T394 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:45258
[junit4:junit4]   2> 7851 T394 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:45258
[junit4:junit4]   2> 7852 T396 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8dbe388e000a with negotiated timeout 20000 for client /127.0.0.1:45258
[junit4:junit4]   2> 7852 T476 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:50326, sessionid = 0x13b8dbe388e000a, negotiated timeout = 20000
[junit4:junit4]   2> 7852 T477 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@254d78 name:ZooKeeperConnection Watcher:127.0.0.1:50326 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 7852 T392 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 7853 T397 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8dbe388e000a
[junit4:junit4]   2> 7854 T394 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:45258 which had sessionid 0x13b8dbe388e000a
[junit4:junit4]   2> 7854 T477 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 7854 T392 oaz.ZooKeeper.close Session: 0x13b8dbe388e000a closed
[junit4:junit4]   2> 7855 T392 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50326/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@1d1ebc5
[junit4:junit4]   2> 7856 T478 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:50326. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 7855 T392 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 7856 T478 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:50326, initiating session
[junit4:junit4]   2> 7856 T394 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:45259
[junit4:junit4]   2> 7856 T394 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:45259
[junit4:junit4]   2> 7857 T396 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8dbe388e000b with negotiated timeout 8000 for client /127.0.0.1:45259
[junit4:junit4]   2> 7857 T478 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:50326, sessionid = 0x13b8dbe388e000b, negotiated timeout = 8000
[junit4:junit4]   2> 7857 T479 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1d1ebc5 name:ZooKeeperConnection Watcher:127.0.0.1:50326/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 7857 T392 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 7858 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8dbe388e000b type:create cxid:0x1 zxid:0xa2 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 7860 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8dbe388e000b type:create cxid:0x2 zxid:0xa3 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 7861 T392 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50894_solr
[junit4:junit4]   2> 7862 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8dbe388e000b type:delete cxid:0x4 zxid:0xa4 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:50894_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:50894_solr
[junit4:junit4]   2> 7862 T392 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50894_solr
[junit4:junit4]   2> 7865 T447 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 7866 T432 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 7866 T462 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 7866 T432 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7866 T415 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 7866 T415 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7866 T462 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7867 T447 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 7868 T392 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 7869 T392 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 7869 T392 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 7869 T392 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 7870 T392 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 7870 T392 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 7871 T392 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 7871 T392 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 7872 T392 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 7872 T392 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 7881 T392 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 7891 T480 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355292759650/collection1
[junit4:junit4]   2> 7891 T480 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 7893 T480 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 7894 T480 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 7896 T480 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355292759650/collection1/'
[junit4:junit4]   2> 7896 T480 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty4-1355292759650/collection1/lib/README' to classloader
[junit4:junit4]   2> 7897 T480 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty4-1355292759650/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 7948 T480 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 7956 T416 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7958 T416 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:43448_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:43448/solr"}
[junit4:junit4]   2> 7968 T432 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7968 T447 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7968 T479 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7969 T415 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7969 T462 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8005 T480 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 8006 T480 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 8016 T480 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> ASYNC  NEW_CORE C21 name=collection1 org.apache.solr.core.SolrCore@1b38a34 url=http://127.0.0.1:44966/solr/collection1 node=127.0.0.1:44966_solr
[junit4:junit4]   2> 8035 T427 C21 P44966 REQ /get {distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=4 
[junit4:junit4]   2> 8399 T480 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 8405 T480 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 8408 T480 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 8422 T480 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 8428 T480 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 8431 T480 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 8433 T480 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 8434 T480 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355292759650/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355292751915/jetty4/
[junit4:junit4]   2> 8434 T480 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@d17b70
[junit4:junit4]   2> 8435 T480 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355292751915/jetty4/index/
[junit4:junit4]   2> 8435 T480 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355292751915/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 8436 T480 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355292751915/jetty4/index forceNew:false
[junit4:junit4]   2> 8439 T480 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355292751915/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@14670de; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 8439 T480 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 8439 T480 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 8441 T480 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 8441 T480 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 8441 T480 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 8442 T480 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 8442 T480 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 8442 T480 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 8443 T480 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 8443 T480 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 8444 T480 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 8445 T480 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 8446 T480 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 8446 T480 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 8447 T480 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 8447 T480 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 8447 T480 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 8448 T480 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 8449 T480 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8449 T480 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8450 T480 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8456 T480 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8457 T480 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8457 T480 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8458 T480 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8459 T480 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 8459 T480 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 8462 T480 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 8463 T480 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 8465 T480 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 8467 T480 oass.SolrIndexSearcher.<init> Opening Searcher@9e375d main
[junit4:junit4]   2> 8467 T480 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 8467 T480 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 8468 T480 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 8468 T480 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 8471 T480 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 8500 T481 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@9e375d main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 8504 T480 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 8504 T480 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 8981 T416 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8983 T416 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:50894_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:50894/solr"}
[junit4:junit4]   2> 8984 T416 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 8984 T416 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4]   2> 8993 T432 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8994 T447 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8994 T462 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8994 T479 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8994 T415 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9009 T480 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 9009 T480 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:50894/solr shardId:shard2
[junit4:junit4]   2> 9013 T480 oasc.ZkController.register We are http://127.0.0.1:50894/solr/collection1/ and leader is http://127.0.0.1:46571/solr/collection1/
[junit4:junit4]   2> 9013 T480 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:50894/solr
[junit4:junit4]   2> 9013 T480 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 9014 T480 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C22 name=collection1 org.apache.solr.core.SolrCore@1ddeab1 url=http://127.0.0.1:50894/solr/collection1 node=127.0.0.1:50894_solr
[junit4:junit4]   2> 9014 T482 C22 P50894 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 9015 T482 C22 P50894 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 9015 T482 C22 P50894 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 9015 T482 C22 P50894 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 9015 T480 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9016 T482 C22 P50894 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:46571/solr/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 9016 T482 C22 P50894 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:50894/solr START replicas=[http://127.0.0.1:46571/solr/collection1/] nUpdates=100
[junit4:junit4]   2> 9017 T482 C22 P50894 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 9017 T482 C22 P50894 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 9017 T482 C22 P50894 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 9017 T392 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 9017 T482 C22 P50894 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 9018 T392 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 9019 T392 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C23 name=collection1 org.apache.solr.core.SolrCore@17708e5 url=http://127.0.0.1:46571/solr/collection1 node=127.0.0.1:46571_solr
[junit4:junit4]   2> 9024 T440 C23 P46571 REQ /get {distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=0 
[junit4:junit4]   2> 9025 T392 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50326/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@c59da5
[junit4:junit4]   2> 9026 T484 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:50326. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 9026 T392 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 9026 T484 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:50326, initiating session
[junit4:junit4]   2> 9026 T394 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:45264
[junit4:junit4]   2> 9027 T394 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:45264
[junit4:junit4]   2> 9027 T396 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8dbe388e000c with negotiated timeout 10000 for client /127.0.0.1:45264
[junit4:junit4]   2> 9027 T484 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:50326, sessionid = 0x13b8dbe388e000c, negotiated timeout = 10000
[junit4:junit4]   2> 9028 T485 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@c59da5 name:ZooKeeperConnection Watcher:127.0.0.1:50326/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 9028 T392 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 9029 T392 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 9032 T392 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 9033 T392 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 9036 T392 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9038 T392 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):540
[junit4:junit4]   2> 9039 T392 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9503 T416 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9504 T416 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:50894_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:50894/solr"}
[junit4:junit4]   2> 9528 T447 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9528 T415 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9529 T432 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9528 T485 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9528 T462 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9529 T479 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10040 T392 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2>  C20_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:43448_solr, base_url=http://127.0.0.1:43448/solr}
[junit4:junit4]   2> 10079 T465 C20 P43448 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 10080 T465 C20 P43448 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 10080 T465 C20 P43448 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:44966/solr/collection1/. core=collection1
[junit4:junit4]   2> 10080 T465 C20 P43448 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 10088 T428 C21 P44966 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16
[junit4:junit4]   2> 10092 T428 C21 P44966 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 10095 T428 C21 P44966 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355292751915/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@daf8bd; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 10095 T428 C21 P44966 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 10118 T428 C21 P44966 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355292751915/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@daf8bd; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355292751915/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@daf8bd; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 10119 T428 C21 P44966 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 10119 T428 C21 P44966 oass.SolrIndexSearcher.<init> Opening Searcher@18edee2 realtime
[junit4:junit4]   2> 10120 T428 C21 P44966 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 10120 T428 C21 P44966 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 10120 T428 C21 P44966 /update {waitSearcher=true&openSearcher=false&commit=true&commit_end_point=true&wt=javabin&softCommit=false&version=2} {commit=} 0 34
[junit4:junit4]   2> 10122 T465 C20 P43448 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 10123 T465 C20 P43448 oascsi.HttpClientUtil.createClient Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
[junit4:junit4]   2> 10128 T465 C20 P43448 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 10148 T425 C21 P44966 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 10149 T425 C21 P44966 REQ /replication {command=indexversion&wt=javabin&qt=/replication&version=2} status=0 QTime=19 
[junit4:junit4]   2> 10150 T465 C20 P43448 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 10150 T465 C20 P43448 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 10150 T465 C20 P43448 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 10153 T426 C21 P44966 REQ /replication {command=filelist&generation=2&wt=javabin&qt=/replication&version=2} status=0 QTime=0 
[junit4:junit4]   2> 10154 T465 C20 P43448 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 10155 T465 C20 P43448 oash.SnapPuller.fetchLatestIndex Starting download to ./org.apache.solr.cloud.BasicDistributedZkTest-1355292751915/jetty3/index.20121212001242061 fullCopy=true
[junit4:junit4]   2> 10160 T428 C21 P44966 REQ /replication {file=segments_2&command=filecontent&checksum=true&generation=2&qt=/replication&wt=filestream} status=0 QTime=1 
[junit4:junit4]   2> 10165 T465 C20 P43448 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 10203 T465 C20 P43448 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20121212001242061
[junit4:junit4]   2> 10215 T465 C20 P43448 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.BasicDistributedZkTest-1355292751915/jetty3/index/ new=./org.apache.solr.cloud.BasicDistributedZkTest-1355292751915/jetty3/index.20121212001242061
[junit4:junit4]   2> 10216 T465 C20 P43448 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355292751915/jetty3/index.20121212001242061 forceNew:false
[junit4:junit4]   2> 10217 T465 C20 P43448 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355292751915/jetty3/index.20121212001242061 lockFactory=org.apache.lucene.store.NativeFSLockFactory@ab0850; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 10218 T465 C20 P43448 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 10219 T465 C20 P43448 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 10220 T465 C20 P43448 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 10220 T465 C20 P43448 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4]   2> 10220 T465 C20 P43448 oasc.CachingDirectoryFactory.close Closing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355292751915/jetty3/index.20121212001242061
[junit4:junit4]   2> 10221 T465 C20 P43448 oash.SnapPuller$2.onClose removing old index directory ./org.apache.solr.cloud.BasicDistributedZkTest-1355292751915/jetty3/index
[junit4:junit4]   2> 10221 T465 C20 P43448 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355292751915/jetty3/index.20121212001242061 forceNew:true
[junit4:junit4]   2> 10223 T465 C20 P43448 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355292751915/jetty3/index.20121212001242061 lockFactory=org.apache.lucene.store.NativeFSLockFactory@13207c6; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 10223 T465 C20 P43448 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 10223 T465 C20 P43448 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 10224 T465 C20 P43448 oass.SolrIndexSearcher.<init> Opening Searcher@1a335ee main
[junit4:junit4]   2> 10224 T465 C20 P43448 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 10225 T464 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1a335ee main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 10225 T465 C20 P43448 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 10280 T465 C20 P43448 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355292751915/jetty3/index.20121212001242061 lockFactory=org.apache.lucene.store.NativeFSLockFactory@13207c6; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355292751915/jetty3/index.20121212001242061 lockFactory=org.apache.lucene.store.NativeFSLockFactory@13207c6; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 10280 T465 C20 P43448 oasc.SolrDeletionPolicy.updateCommits newest commit = 3
[junit4:junit4]   2> 10281 T465 C20 P43448 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 10281 T465 C20 P43448 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 10281 T465 C20 P43448 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 10281 T465 C20 P43448 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 10281 T465 C20 P43448 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 10283 T465 C20 P43448 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 10541 T416 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10542 T416 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:43448_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:43448/solr"}
[junit4:junit4]   2> 10608 T447 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10608 T432 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10609 T479 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10609 T415 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10609 T462 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10609 T485 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 11042 T392 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2>  C22_STATE=coll:collection1 core:collection1 props:{shard=shard2, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:50894_solr, base_url=http://127.0.0.1:50894/solr}
[junit4:junit4]   2> 12024 T482 C22 P50894 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 12024 T482 C22 P50894 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 12025 T482 C22 P50894 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:46571/solr/collection1/. core=collection1
[junit4:junit4]   2> 12025 T482 C22 P50894 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 12032 T441 C23 P46571 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 12035 T441 C23 P46571 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355292751915/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1345817; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 12035 T441 C23 P46571 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 12044 T392 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 12068 T441 C23 P46571 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355292751915/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1345817; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355292751915/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1345817; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 12069 T441 C23 P46571 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 12069 T441 C23 P46571 oass.SolrIndexSearcher.<init> Opening Searcher@1ea3e3d realtime
[junit4:junit4]   2> 12069 T441 C23 P46571 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 12070 T441 C23 P46571 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 12070 T441 C23 P46571 /update {waitSearcher=true&openSearcher=false&commit=true&commit_end_point=true&wt=javabin&softCommit=false&version=2} {commit=} 0 38
[junit4:junit4]   2> 12071 T482 C22 P50894 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 12072 T482 C22 P50894 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 12074 T442 C23 P46571 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 12074 T442 C23 P46571 REQ /replication {command=indexversion&wt=javabin&qt=/replication&version=2} status=0 QTime=1 
[junit4:junit4]   2> 12075 T482 C22 P50894 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 12075 T482 C22 P50894 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 12075 T482 C22 P50894 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 12078 T443 C23 P46571 REQ /replication {command=filelist&generation=2&wt=javabin&qt=/replication&version=2} status=0 QTime=0 
[junit4:junit4]   2> 12079 T482 C22 P50894 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 12080 T482 C22 P50894 oash.SnapPuller.fetchLatestIndex Starting download to ./org.apache.solr.cloud.BasicDistributedZkTest-1355292751915/jetty4/index.20121212001243986 fullCopy=true
[junit4:junit4]   2> 12082 T441 C23 P46571 REQ /replication {file=segments_2&command=filecontent&checksum=true&generation=2&qt=/replication&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 12084 T482 C22 P50894 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 12088 T482 C22 P50894 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20121212001243986
[junit4:junit4]   2> 12089 T482 C22 P50894 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.BasicDistributedZkTest-1355292751915/jetty4/index/ new=./org.apache.solr.cloud.BasicDistributedZkTest-1355292751915/jetty4/index.20121212001243986
[junit4:junit4]   2> 12089 T482 C22 P50894 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355292751915/jetty4/index.20121212001243986 forceNew:false
[junit4:junit4]   2> 12091 T482 C22 P50894 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355292751915/jetty4/index.20121212001243986 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4dd0f1; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 12091 T482 C22 P50894 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 12092 T482 C22 P50894 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 12092 T482 C22 P50894 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 12092 T482 C22 P50894 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4]   2> 12092 T482 C22 P50894 oasc.CachingDirectoryFactory.close Closing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355292751915/jetty4/index.20121212001243986
[junit4:junit4]   2> 12093 T482 C22 P50894 oash.SnapPuller$2.onClose removing old index directory ./org.apache.solr.cloud.BasicDistributedZkTest-1355292751915/jetty4/index
[junit4:junit4]   2> 12093 T482 C22 P50894 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355292751915/jetty4/index.20121212001243986 forceNew:true
[junit4:junit4]   2> 12094 T482 C22 P50894 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355292751915/jetty4/index.20121212001243986 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1c33fcd; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 12095 T482 C22 P50894 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 12095 T482 C22 P50894 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 12095 T482 C22 P50894 oass.SolrIndexSearcher.<init> Opening Searcher@dcdd35 main
[junit4:junit4]   2> 12095 T482 C22 P50894 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 12097 T481 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@dcdd35 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 12097 T482 C22 P50894 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 12139 T482 C22 P50894 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355292751915/jetty4/index.20121212001243986 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1c33fcd; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355292751915/jetty4/index.20121212001243986 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1c33fcd; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 12140 T482 C22 P50894 oasc.SolrDeletionPolicy.updateCommits newest commit = 3
[junit4:junit4]   2> 12140 T482 C22 P50894 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 12141 T482 C22 P50894 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 12141 T482 C22 P50894 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 12141 T482 C22 P50894 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 12141 T482 C22 P50894 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 12142 T482 C22 P50894 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 12621 T416 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 12621 T416 oasc.Overseer$ClusterSt

[...truncated too long message...]

)
[junit4:junit4]   1>  DATA:
[junit4:junit4]   1>      
[junit4:junit4]   1> 
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=SyncSliceTest -Dtests.method=testDistribSearch -Dtests.seed=705D8AC5215FB46A -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ar_LY -Dtests.timezone=Asia/Bishkek -Dtests.file.encoding=UTF-8
[junit4:junit4] FAILURE  584s J0 | SyncSliceTest.testDistribSearch <<<
[junit4:junit4]    > Throwable #1: java.lang.AssertionError: There are still nodes recoverying - waited for 540 seconds
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([705D8AC5215FB46A:F1BB04DD5600D456]:0)
[junit4:junit4]    > 	at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:165)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:115)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:110)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:563)
[junit4:junit4]    > 	at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:224)
[junit4:junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:601)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 584156 T1519 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> NOTE: test params are: codec=Lucene40, sim=RandomSimilarityProvider(queryNorm=false,coord=no): {}, locale=ar_LY, timezone=Asia/Bishkek
[junit4:junit4]   2> NOTE: Linux 3.2.0-34-generic i386/Oracle Corporation 1.7.0_09 (32-bit)/cpus=8,threads=2,free=190712680,total=518979584
[junit4:junit4]   2> NOTE: All tests run in this JVM: [TestAnalyzedSuggestions, TestSolrIndexConfig, NumericFieldsTest, TestCollationField, TestJoin, SortByFunctionTest, WordBreakSolrSpellCheckerTest, JsonLoaderTest, SpellPossibilityIteratorTest, TestNumberUtils, DistanceFunctionTest, TestFastOutputStream, TestQuerySenderNoQuery, ResponseLogComponentTest, TestPerFieldSimilarity, TestRandomFaceting, TestRangeQuery, JSONWriterTest, TestSolrQueryParser, SolrPluginUtilsTest, SampleTest, TestStressReorder, CopyFieldTest, DefaultValueUpdateProcessorTest, TestBinaryResponseWriter, SearchHandlerTest, SpatialFilterTest, SolrRequestParserTest, TestPseudoReturnFields, BasicDistributedZkTest, IndexBasedSpellCheckerTest, TestJmxMonitoredMap, TestGroupingSearch, TestCoreContainer, NoCacheHeaderTest, TestIndexingPerformance, PreAnalyzedFieldTest, SolrCoreCheckLockOnStartupTest, TestPHPSerializedResponseWriter, NotRequiredUniqueKeyTest, TestIBSimilarityFactory, AnalysisAfterCoreReloadTest, TestFiltering, SimplePostToolTest, TestLMJelinekMercerSimilarityFactory, SuggesterFSTTest, ScriptEngineTest, DateFieldTest, FieldAnalysisRequestHandlerTest, SystemInfoHandlerTest, HighlighterConfigTest, MinimalSchemaTest, ZkControllerTest, TestLuceneMatchVersion, BadComponentTest, BinaryUpdateRequestHandlerTest, UpdateRequestProcessorFactoryTest, ResourceLoaderTest, DateMathParserTest, TestTrie, CacheHeaderTest, TestWordDelimiterFilterFactory, MoreLikeThisHandlerTest, MBeansHandlerTest, QueryParsingTest, XsltUpdateRequestHandlerTest, XmlUpdateRequestHandlerTest, DocumentAnalysisRequestHandlerTest, DirectUpdateHandlerOptimizeTest, DebugComponentTest, RequiredFieldsTest, TestQueryUtils, SuggesterTSTTest, UniqFieldsUpdateProcessorFactoryTest, UpdateParamsTest, SuggesterTest, BadIndexSchemaTest, AlternateDirectoryTest, TestBinaryField, SOLR749Test, TestMergePolicyConfig, TestDocSet, OutputWriterTest, TestConfig, TestLMDirichletSimilarityFactory, TestDefaultSimilarityFactory, TestFastLRUCache, TestSystemIdResolver, TestSuggestSpellingConverter, UUIDFieldTest, RAMDirectoryFactoryTest, CircularListTest, TestCollationKeyRangeQueries, ClusterStateTest, ClusterStateUpdateTest, OverseerCollectionProcessorTest, SyncSliceTest]
[junit4:junit4] Completed on J0 in 584.18s, 1 test, 1 failure <<< FAILURES!

[...truncated 36 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:352: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:178: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:438: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1171: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:835: There were test failures: 239 suites, 994 tests, 1 error, 2 failures, 7 ignored (2 assumptions)

Total time: 34 minutes 55 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 32bit/jdk1.7.0_09 -server -XX:+UseConcMarkSweepGC
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-4.x-Linux (64bit/jrockit-jdk1.6.0_33-R28.2.4-4.1.0) - Build # 3176 - Still Failing!

Posted by Policeman Jenkins Server <je...@sd-datasolutions.de>.
Build: http://jenkins.sd-datasolutions.de/job/Lucene-Solr-4.x-Linux/3176/
Java: 64bit/jrockit-jdk1.6.0_33-R28.2.4-4.1.0 -XnoOpt

3 tests failed.
FAILED:  org.apache.solr.cloud.SyncSliceTest.testDistribSearch

Error Message:
There are still nodes recoverying - waited for 540 seconds

Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 540 seconds
	at __randomizedtesting.SeedInfo.seed([75B21CF88F8DEB2F:F45492E0F8D28B13]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:165)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:115)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:110)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:563)
	at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:224)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:738)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:774)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:683)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:44)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:56)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:662)


FAILED:  org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch

Error Message:
There are still nodes recoverying - waited for 540 seconds

Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 540 seconds
	at __randomizedtesting.SeedInfo.seed([75B21CF88F8DEB2F:F45492E0F8D28B13]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:165)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:115)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:110)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:563)
	at org.apache.solr.cloud.BasicDistributedZk2Test.brindDownShardIndexSomeDocsAndRecover(BasicDistributedZk2Test.java:321)
	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:83)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:738)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:774)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:683)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:44)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:56)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:662)


FAILED:  org.apache.solr.cloud.BasicDistributedZkTest.testDistribSearch

Error Message:
Server at http://127.0.0.1:48776/solr returned non ok status:500, message:Server Error

Stack Trace:
org.apache.solr.common.SolrException: Server at http://127.0.0.1:48776/solr returned non ok status:500, message:Server Error
	at __randomizedtesting.SeedInfo.seed([75B21CF88F8DEB2F:F45492E0F8D28B13]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:372)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
	at org.apache.solr.client.solrj.request.CoreAdminRequest.process(CoreAdminRequest.java:429)
	at org.apache.solr.client.solrj.request.CoreAdminRequest.getStatus(CoreAdminRequest.java:472)
	at org.apache.solr.cloud.BasicDistributedZkTest.collectStartTimes(BasicDistributedZkTest.java:959)
	at org.apache.solr.cloud.BasicDistributedZkTest.testCollectionsAPI(BasicDistributedZkTest.java:795)
	at org.apache.solr.cloud.BasicDistributedZkTest.doTest(BasicDistributedZkTest.java:344)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:738)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:774)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:683)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:44)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:56)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:662)




Build Log:
[...truncated 7887 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZkTest
[junit4:junit4]   2> 70 T273 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZkTest-1355288077057
[junit4:junit4]   2> 74 T273 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 82 T274 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 102 T274 oaz.Environment.logEnv Server environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
[junit4:junit4]   2> 102 T274 oaz.Environment.logEnv Server environment:host.name=serv1
[junit4:junit4]   2> 102 T274 oaz.Environment.logEnv Server environment:java.version=1.6.0_33
[junit4:junit4]   2> 102 T274 oaz.Environment.logEnv Server environment:java.vendor=Oracle Corporation
[junit4:junit4]   2> 102 T274 oaz.Environment.logEnv Server environment:java.home=/mnt/ssd/jenkins/tools/java/64bit/jrockit-jdk1.6.0_33-R28.2.4-4.1.0/jre
[junit4:junit4]   2> 103 T274 oaz.Environment.logEnv Server environment:java.class.path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/test:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/codecs/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-solrj/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/common/lucene-analyzers-common-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/highlighter/lucene-highlighter-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/memory/lucene-memory-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/misc/lucene-misc-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/spatial/lucene-spatial-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/suggest/lucene-suggest-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/grouping/lucene-grouping-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queries/lucene-queries-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queryparser/lucene-queryparser-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/cglib-nodep-2.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-cli-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-codec-1.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-fileupload-1.2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-lang-2.6.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/easymock-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/guava-13.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/javax.servlet-api-3.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/metrics-core-2.1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/objenesis-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/spatial4j-0.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/commons-io-2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpclient-4.1.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpcore-4.1.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpmime-4.1.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/jcl-over-slf4j-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/log4j-over-slf4j-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-api-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-jdk14-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/wstx-asl-3.2.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/zookeeper-3.4.5.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-continuation-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-deploy-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-http-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-io-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-jmx-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-security-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-server-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-servlet-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-util-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-webapp-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-xml-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/servlet-api-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/hsqldb-1.8.0.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/junit-4.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/randomizedtesting-runner-2.0.5.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-launcher.jar:/var/lib/jenkins/.ant/lib/ivy-2.2.0.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jdepend.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-netrexx.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-antlr.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-commons-net.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-javamail.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-regexp.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jsch.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-xalan2.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-junit4.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jmf.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-junit.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-bcel.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jai.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-commons-logging.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-resolver.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-oro.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-swing.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-bsf.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-log4j.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-testutil.jar:/mnt/ssd/jenkins/tools/java/64bit/jrockit-jdk1.6.0_33-R28.2.4-4.1.0/lib/tools.jar:/var/lib/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.0.5.jar
[junit4:junit4]   2> 104 T274 oaz.Environment.logEnv Server environment:java.library.path=/usr/java/packages/lib/amd64:/mnt/ssd/jenkins/tools/java/64bit/jrockit-jdk1.6.0_33-R28.2.4-4.1.0/jre/lib/amd64/jrockit:/mnt/ssd/jenkins/tools/java/64bit/jrockit-jdk1.6.0_33-R28.2.4-4.1.0/jre/lib/amd64:/mnt/ssd/jenkins/tools/java/64bit/jrockit-jdk1.6.0_33-R28.2.4-4.1.0/jre/../lib/amd64:/usr/lib/jvm/j2sdk1.6-sun/jre/lib/amd64/server:/usr/lib/jvm/j2sdk1.6-sun/jre/lib/amd64:/usr/lib/jvm/j2sdk1.6-sun/jre/../lib/amd64
[junit4:junit4]   2> 105 T274 oaz.Environment.logEnv Server environment:java.io.tmpdir=.
[junit4:junit4]   2> 105 T274 oaz.Environment.logEnv Server environment:java.compiler=<NA>
[junit4:junit4]   2> 105 T274 oaz.Environment.logEnv Server environment:os.name=Linux
[junit4:junit4]   2> 105 T274 oaz.Environment.logEnv Server environment:os.arch=amd64
[junit4:junit4]   2> 105 T274 oaz.Environment.logEnv Server environment:os.version=3.2.0-34-generic
[junit4:junit4]   2> 105 T274 oaz.Environment.logEnv Server environment:user.name=jenkins
[junit4:junit4]   2> 105 T274 oaz.Environment.logEnv Server environment:user.home=/var/lib/jenkins
[junit4:junit4]   2> 106 T274 oaz.Environment.logEnv Server environment:user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 120 T274 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 121 T274 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4]   2> 121 T274 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4]   2> 128 T274 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 160 T274 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355288077057/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4]   2> 176 T273 oasc.ZkTestServer.run start zk server on port:50576
[junit4:junit4]   2> 216 T273 oaz.Environment.logEnv Client environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
[junit4:junit4]   2> 216 T273 oaz.Environment.logEnv Client environment:host.name=serv1
[junit4:junit4]   2> 217 T273 oaz.Environment.logEnv Client environment:java.version=1.6.0_33
[junit4:junit4]   2> 217 T273 oaz.Environment.logEnv Client environment:java.vendor=Oracle Corporation
[junit4:junit4]   2> 217 T273 oaz.Environment.logEnv Client environment:java.home=/mnt/ssd/jenkins/tools/java/64bit/jrockit-jdk1.6.0_33-R28.2.4-4.1.0/jre
[junit4:junit4]   2> 218 T273 oaz.Environment.logEnv Client environment:java.class.path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/test:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/codecs/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-solrj/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/common/lucene-analyzers-common-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/highlighter/lucene-highlighter-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/memory/lucene-memory-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/misc/lucene-misc-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/spatial/lucene-spatial-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/suggest/lucene-suggest-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/grouping/lucene-grouping-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queries/lucene-queries-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queryparser/lucene-queryparser-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/cglib-nodep-2.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-cli-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-codec-1.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-fileupload-1.2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-lang-2.6.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/easymock-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/guava-13.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/javax.servlet-api-3.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/metrics-core-2.1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/objenesis-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/spatial4j-0.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/commons-io-2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpclient-4.1.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpcore-4.1.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpmime-4.1.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/jcl-over-slf4j-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/log4j-over-slf4j-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-api-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-jdk14-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/wstx-asl-3.2.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/zookeeper-3.4.5.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-continuation-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-deploy-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-http-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-io-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-jmx-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-security-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-server-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-servlet-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-util-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-webapp-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-xml-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/servlet-api-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/hsqldb-1.8.0.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/junit-4.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/randomizedtesting-runner-2.0.5.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-launcher.jar:/var/lib/jenkins/.ant/lib/ivy-2.2.0.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jdepend.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-netrexx.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-antlr.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-commons-net.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-javamail.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-regexp.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jsch.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-xalan2.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-junit4.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jmf.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-junit.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-bcel.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jai.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-commons-logging.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-resolver.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-oro.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-swing.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-bsf.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-log4j.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-testutil.jar:/mnt/ssd/jenkins/tools/java/64bit/jrockit-jdk1.6.0_33-R28.2.4-4.1.0/lib/tools.jar:/var/lib/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.0.5.jar
[junit4:junit4]   2> 219 T273 oaz.Environment.logEnv Client environment:java.library.path=/usr/java/packages/lib/amd64:/mnt/ssd/jenkins/tools/java/64bit/jrockit-jdk1.6.0_33-R28.2.4-4.1.0/jre/lib/amd64/jrockit:/mnt/ssd/jenkins/tools/java/64bit/jrockit-jdk1.6.0_33-R28.2.4-4.1.0/jre/lib/amd64:/mnt/ssd/jenkins/tools/java/64bit/jrockit-jdk1.6.0_33-R28.2.4-4.1.0/jre/../lib/amd64:/usr/lib/jvm/j2sdk1.6-sun/jre/lib/amd64/server:/usr/lib/jvm/j2sdk1.6-sun/jre/lib/amd64:/usr/lib/jvm/j2sdk1.6-sun/jre/../lib/amd64
[junit4:junit4]   2> 220 T273 oaz.Environment.logEnv Client environment:java.io.tmpdir=.
[junit4:junit4]   2> 220 T273 oaz.Environment.logEnv Client environment:java.compiler=<NA>
[junit4:junit4]   2> 220 T273 oaz.Environment.logEnv Client environment:os.name=Linux
[junit4:junit4]   2> 221 T273 oaz.Environment.logEnv Client environment:os.arch=amd64
[junit4:junit4]   2> 221 T273 oaz.Environment.logEnv Client environment:os.version=3.2.0-34-generic
[junit4:junit4]   2> 221 T273 oaz.Environment.logEnv Client environment:user.name=jenkins
[junit4:junit4]   2> 221 T273 oaz.Environment.logEnv Client environment:user.home=/var/lib/jenkins
[junit4:junit4]   2> 222 T273 oaz.Environment.logEnv Client environment:user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 227 T273 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50576 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1c7e9772
[junit4:junit4]   2> 250 T273 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 258 T279 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:50576. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 263 T275 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:54014
[junit4:junit4]   2> 272 T279 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:50576, initiating session
[junit4:junit4]   2> 301 T275 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:54014
[junit4:junit4]   2> 326 T277 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 374 T277 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8d76e36e0000 with negotiated timeout 10000 for client /127.0.0.1:54014
[junit4:junit4]   2> 377 T279 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:50576, sessionid = 0x13b8d76e36e0000, negotiated timeout = 10000
[junit4:junit4]   2> 392 T280 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c7e9772 name:ZooKeeperConnection Watcher:127.0.0.1:50576 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 393 T273 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 395 T273 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 446 T278 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8d76e36e0000
[junit4:junit4]   2> 449 T280 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 449 T273 oaz.ZooKeeper.close Session: 0x13b8d76e36e0000 closed
[junit4:junit4]   2> 449 T273 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50576/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1c9a309e
[junit4:junit4]   2> 450 T281 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:50576. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 450 T273 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 451 T281 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:50576, initiating session
[junit4:junit4]   2> 456 T275 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:54014 which had sessionid 0x13b8d76e36e0000
[junit4:junit4]   2> 456 T275 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:54015
[junit4:junit4]   2> 457 T275 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:54015
[junit4:junit4]   2> 457 T277 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8d76e36e0001 with negotiated timeout 10000 for client /127.0.0.1:54015
[junit4:junit4]   2> 457 T281 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:50576, sessionid = 0x13b8d76e36e0001, negotiated timeout = 10000
[junit4:junit4]   2> 457 T282 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c9a309e name:ZooKeeperConnection Watcher:127.0.0.1:50576/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 458 T273 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 464 T273 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 467 T273 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 468 T273 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 470 T273 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 472 T273 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 481 T273 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 484 T273 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 485 T273 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 487 T273 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 488 T273 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 493 T273 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 493 T273 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 495 T273 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 496 T273 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 497 T273 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 498 T273 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 499 T273 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 500 T273 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 501 T273 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 502 T273 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 503 T273 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 504 T273 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 505 T273 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 506 T273 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 507 T278 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8d76e36e0001
[junit4:junit4]   2> 508 T275 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:54015 which had sessionid 0x13b8d76e36e0001
[junit4:junit4]   2> 508 T273 oaz.ZooKeeper.close Session: 0x13b8d76e36e0001 closed
[junit4:junit4]   2> 508 T282 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 574 T273 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 577 T273 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:48776
[junit4:junit4]   2> 578 T273 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 578 T273 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355288077495
[junit4:junit4]   2> 578 T273 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355288077495/'
[junit4:junit4]   2> 591 T273 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 591 T273 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 591 T273 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355288077495
[junit4:junit4]   2> 592 T273 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355288077495/solr.xml
[junit4:junit4]   2> 592 T273 oasc.CoreContainer.<init> New CoreContainer 480723805
[junit4:junit4]   2> 593 T273 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355288077495/'
[junit4:junit4]   2> 593 T273 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355288077495/'
[junit4:junit4]   2> 609 T273 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 621 T273 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:50576/solr
[junit4:junit4]   2> 628 T273 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 628 T273 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50576 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1cb842ad
[junit4:junit4]   2> 629 T273 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 629 T292 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:50576. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 629 T292 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:50576, initiating session
[junit4:junit4]   2> 629 T275 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:54016
[junit4:junit4]   2> 630 T275 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:54016
[junit4:junit4]   2> 631 T277 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8d76e36e0002 with negotiated timeout 20000 for client /127.0.0.1:54016
[junit4:junit4]   2> 631 T292 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:50576, sessionid = 0x13b8d76e36e0002, negotiated timeout = 20000
[junit4:junit4]   2> 631 T293 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1cb842ad name:ZooKeeperConnection Watcher:127.0.0.1:50576 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 632 T273 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 633 T278 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8d76e36e0002
[junit4:junit4]   2> 634 T293 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 633 T273 oaz.ZooKeeper.close Session: 0x13b8d76e36e0002 closed
[junit4:junit4]   2> 634 T275 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:54016 which had sessionid 0x13b8d76e36e0002
[junit4:junit4]   2> 639 T273 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50576/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@1cb914e2
[junit4:junit4]   2> 640 T273 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 640 T294 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:50576. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 640 T294 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:50576, initiating session
[junit4:junit4]   2> 640 T275 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:54017
[junit4:junit4]   2> 640 T275 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:54017
[junit4:junit4]   2> 641 T277 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8d76e36e0003 with negotiated timeout 8000 for client /127.0.0.1:54017
[junit4:junit4]   2> 641 T294 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:50576, sessionid = 0x13b8d76e36e0003, negotiated timeout = 8000
[junit4:junit4]   2> 641 T295 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1cb914e2 name:ZooKeeperConnection Watcher:127.0.0.1:50576/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 641 T273 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 650 T278 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d76e36e0003 type:create cxid:0x2 zxid:0x1b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 656 T273 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 658 T273 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48776_solr
[junit4:junit4]   2> 660 T278 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d76e36e0003 type:delete cxid:0x7 zxid:0x1d txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:48776_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:48776_solr
[junit4:junit4]   2> 661 T273 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:48776_solr
[junit4:junit4]   2> 663 T273 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 663 T273 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 663 T273 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 663 T273 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 664 T273 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 664 T273 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 664 T273 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 665 T273 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 665 T273 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 665 T273 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 669 T273 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 678 T278 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d76e36e0003 type:delete cxid:0x15 zxid:0x22 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 679 T273 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 684 T273 oasc.Overseer.start Overseer (id=88820159425150979-127.0.0.1:48776_solr-n_0000000000) starting
[junit4:junit4]   2> 684 T278 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d76e36e0003 type:create cxid:0x1a zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 685 T278 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d76e36e0003 type:create cxid:0x1b zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 686 T278 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d76e36e0003 type:create cxid:0x1c zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 688 T278 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d76e36e0003 type:create cxid:0x1d zxid:0x27 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 690 T297 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
[junit4:junit4]   2> 690 T273 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 695 T273 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 707 T296 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 710 T298 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355288077495/collection1
[junit4:junit4]   2> 712 T298 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4]   2> 712 T298 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 713 T298 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4]   2> 714 T298 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355288077495/collection1/'
[junit4:junit4]   2> 715 T298 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355288077495/collection1/lib/README' to classloader
[junit4:junit4]   2> 715 T298 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355288077495/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 767 T298 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 821 T298 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 822 T298 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 827 T298 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 1294 T298 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 1301 T298 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 1304 T298 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 1313 T298 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1316 T298 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1319 T298 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1320 T298 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1321 T298 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355288077495/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355288077057/control/data/
[junit4:junit4]   2> 1321 T298 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c05ec77
[junit4:junit4]   2> 1327 T298 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355288077057/control/data/index/
[junit4:junit4]   2> 1327 T298 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355288077057/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 1328 T298 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355288077057/control/data/index forceNew:false
[junit4:junit4]   2> 1331 T298 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355288077057/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1c7844d7),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 1331 T298 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 1332 T298 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 1333 T298 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 1333 T298 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 1333 T298 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 1333 T298 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 1334 T298 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 1334 T298 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 1334 T298 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 1335 T298 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 1336 T298 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 1336 T298 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 1337 T298 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 1337 T298 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 1338 T298 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 1338 T298 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 1338 T298 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 1339 T298 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 1340 T298 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1340 T298 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1341 T298 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1342 T298 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1342 T298 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1343 T298 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1344 T298 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1345 T298 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 1345 T298 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 1348 T298 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 1351 T298 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 1353 T298 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 1355 T298 oass.SolrIndexSearcher.<init> Opening Searcher@1c800ba3 main
[junit4:junit4]   2> 1355 T298 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 1355 T298 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 1356 T298 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 1356 T298 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 1359 T298 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 1383 T299 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1c800ba3 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 1390 T298 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 1390 T298 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 1391 T278 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d76e36e0003 type:create cxid:0x53 zxid:0x2a txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 1393 T298 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 1394 T298 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:48776/solr shardId:control_shard
[junit4:junit4]   2> 1399 T298 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4]   2> 1403 T298 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/control_shard/election
[junit4:junit4]   2> 1407 T278 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d76e36e0003 type:delete cxid:0x62 zxid:0x31 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4]   2> 1410 T298 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 1410 T278 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d76e36e0003 type:create cxid:0x63 zxid:0x32 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1712 T296 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 1717 T296 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":"control_shard",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:48776_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:48776/solr"}
[junit4:junit4]   2> 1724 T278 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d76e36e0003 type:create cxid:0x6a zxid:0x34 txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 1737 T295 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 1913 T298 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 1913 T298 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 1914 T298 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:48776/solr/collection1/
[junit4:junit4]   2> 1918 T298 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 1919 T298 oasc.SyncStrategy.syncToMe http://127.0.0.1:48776/solr/collection1/ has no replicas
[junit4:junit4]   2> 1920 T298 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:48776/solr/collection1/
[junit4:junit4]   2> 1920 T298 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/control_shard
[junit4:junit4]   2> 1923 T278 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d76e36e0003 type:create cxid:0x89 zxid:0x3f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2240 T296 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2242 T295 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 2277 T298 oasc.ZkController.register We are http://127.0.0.1:48776/solr/collection1/ and leader is http://127.0.0.1:48776/solr/collection1/
[junit4:junit4]   2> 2277 T298 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:48776/solr
[junit4:junit4]   2> 2278 T298 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 2278 T298 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 2278 T298 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 2279 T298 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2280 T273 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 2281 T273 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 2281 T273 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 2344 T273 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 2346 T273 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:56314
[junit4:junit4]   2> 2346 T273 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 2347 T273 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355288079272
[junit4:junit4]   2> 2347 T273 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355288079272/'
[junit4:junit4]   2> 2364 T273 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 2365 T273 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 2365 T273 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355288079272
[junit4:junit4]   2> 2366 T273 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355288079272/solr.xml
[junit4:junit4]   2> 2366 T273 oasc.CoreContainer.<init> New CoreContainer 476006155
[junit4:junit4]   2> 2367 T273 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355288079272/'
[junit4:junit4]   2> 2367 T273 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355288079272/'
[junit4:junit4]   2> 2381 T273 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 2394 T273 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:50576/solr
[junit4:junit4]   2> 2395 T273 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 2395 T273 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50576 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1c98853e
[junit4:junit4]   2> 2396 T273 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2396 T309 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:50576. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 2397 T309 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:50576, initiating session
[junit4:junit4]   2> 2397 T275 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:54019
[junit4:junit4]   2> 2397 T275 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:54019
[junit4:junit4]   2> 2398 T277 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8d76e36e0004 with negotiated timeout 20000 for client /127.0.0.1:54019
[junit4:junit4]   2> 2398 T309 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:50576, sessionid = 0x13b8d76e36e0004, negotiated timeout = 20000
[junit4:junit4]   2> 2398 T310 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c98853e name:ZooKeeperConnection Watcher:127.0.0.1:50576 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2398 T273 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2399 T278 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8d76e36e0004
[junit4:junit4]   2> 2400 T310 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 2400 T273 oaz.ZooKeeper.close Session: 0x13b8d76e36e0004 closed
[junit4:junit4]   2> 2400 T275 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:54019 which had sessionid 0x13b8d76e36e0004
[junit4:junit4]   2> 2400 T273 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50576/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@1c98df69
[junit4:junit4]   2> 2401 T311 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:50576. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 2401 T273 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2402 T311 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:50576, initiating session
[junit4:junit4]   2> 2402 T275 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:54020
[junit4:junit4]   2> 2402 T275 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:54020
[junit4:junit4]   2> 2403 T277 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8d76e36e0005 with negotiated timeout 8000 for client /127.0.0.1:54020
[junit4:junit4]   2> 2403 T311 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:50576, sessionid = 0x13b8d76e36e0005, negotiated timeout = 8000
[junit4:junit4]   2> 2403 T312 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c98df69 name:ZooKeeperConnection Watcher:127.0.0.1:50576/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2403 T273 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2404 T278 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d76e36e0005 type:create cxid:0x1 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2404 T278 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d76e36e0005 type:create cxid:0x2 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2405 T273 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56314_solr
[junit4:junit4]   2> 2405 T278 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d76e36e0005 type:delete cxid:0x4 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:56314_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:56314_solr
[junit4:junit4]   2> 2406 T273 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56314_solr
[junit4:junit4]   2> 2407 T295 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 2408 T273 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 2408 T273 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 2408 T273 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 2409 T273 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 2409 T273 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 2409 T295 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 2409 T273 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 2410 T273 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 2410 T273 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 2410 T273 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 2410 T273 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 2416 T273 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 2422 T313 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355288079272/collection1
[junit4:junit4]   2> 2422 T313 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 2422 T313 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 2423 T313 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 2423 T313 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355288079272/collection1/'
[junit4:junit4]   2> 2424 T313 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty1-1355288079272/collection1/lib/README' to classloader
[junit4:junit4]   2> 2424 T313 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty1-1355288079272/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 2466 T313 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 2521 T313 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 2522 T313 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 2527 T313 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 2745 T296 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2745 T296 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":"control_shard",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:48776_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:48776/solr"}
[junit4:junit4]   2> 2748 T312 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 2748 T295 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3020 T313 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 3027 T313 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 3031 T313 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 3043 T313 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 3046 T313 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 3048 T313 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 3049 T313 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 3050 T313 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355288079272/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355288077057/jetty1/
[junit4:junit4]   2> 3050 T313 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c05ec77
[junit4:junit4]   2> 3051 T313 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355288077057/jetty1/index/
[junit4:junit4]   2> 3051 T313 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355288077057/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 3052 T313 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355288077057/jetty1/index forceNew:false
[junit4:junit4]   2> 3056 T313 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355288077057/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1c5e7cc4),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 3056 T313 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 3056 T313 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 3057 T313 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 3057 T313 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 3058 T313 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 3058 T313 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 3058 T313 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 3058 T313 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 3059 T313 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 3059 T313 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 3060 T313 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 3061 T313 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 3062 T313 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 3062 T313 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 3063 T313 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 3063 T313 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 3063 T313 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 3064 T313 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 3065 T313 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3065 T313 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3066 T313 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3067 T313 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3068 T313 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3068 T313 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3069 T313 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3070 T313 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 3071 T313 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 3073 T313 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 3074 T313 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 3075 T313 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 3078 T313 oass.SolrIndexSearcher.<init> Opening Searcher@1c71defe main
[junit4:junit4]   2> 3078 T313 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 3078 T313 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 3078 T313 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 3079 T313 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 3082 T313 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 3110 T314 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1c71defe main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 3115 T313 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 3116 T313 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 3251 T296 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3251 T296 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:56314_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:56314/solr"}
[junit4:junit4]   2> 3252 T296 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4]   2> 3255 T296 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 3258 T312 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3258 T295 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3619 T313 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 3620 T313 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:56314/solr shardId:shard1
[junit4:junit4]   2> 3620 T313 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 3624 T278 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d76e36e0005 type:delete cxid:0x45 zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 3625 T313 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 3625 T278 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d76e36e0005 type:create cxid:0x46 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3626 T313 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 3626 T313 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 3627 T313 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:56314/solr/collection1/
[junit4:junit4]   2> 3627 T313 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 3627 T313 oasc.SyncStrategy.syncToMe http://127.0.0.1:56314/solr/collection1/ has no replicas
[junit4:junit4]   2> 3628 T313 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:56314/solr/collection1/
[junit4:junit4]   2> 3628 T313 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 3632 T278 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d76e36e0005 type:create cxid:0x50 zxid:0x60 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3761 T296 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3766 T312 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3766 T295 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3784 T313 oasc.ZkController.register We are http://127.0.0.1:56314/solr/collection1/ and leader is http://127.0.0.1:56314/solr/collection1/
[junit4:junit4]   2> 3784 T313 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:56314/solr
[junit4:junit4]   2> 3784 T313 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 3785 T313 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 3785 T313 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 3786 T313 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3787 T273 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 3788 T273 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 3788 T273 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 3845 T273 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 3846 T273 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:33795
[junit4:junit4]   2> 3847 T273 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 3847 T273 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355288080777
[junit4:junit4]   2> 3848 T273 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355288080777/'
[junit4:junit4]   2> 3861 T273 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 3861 T273 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 3861 T273 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355288080777
[junit4:junit4]   2> 3862 T273 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355288080777/solr.xml
[junit4:junit4]   2> 3862 T273 oasc.CoreContainer.<init> New CoreContainer 480031317
[junit4:junit4]   2> 3862 T273 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355288080777/'
[junit4:junit4]   2> 3863 T273 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355288080777/'
[junit4:junit4]   2> 3877 T273 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 3889 T273 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:50576/solr
[junit4:junit4]   2> 3890 T273 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 3890 T273 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50576 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1c651db0
[junit4:junit4]   2> 3891 T273 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3891 T324 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:50576. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 3891 T324 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:50576, initiating session
[junit4:junit4]   2> 3892 T275 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:54021
[junit4:junit4]   2> 3892 T275 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:54021
[junit4:junit4]   2> 3892 T277 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8d76e36e0006 with negotiated timeout 20000 for client /127.0.0.1:54021
[junit4:junit4]   2> 3892 T324 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:50576, sessionid = 0x13b8d76e36e0006, negotiated timeout = 20000
[junit4:junit4]   2> 3893 T325 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c651db0 name:ZooKeeperConnection Watcher:127.0.0.1:50576 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3893 T273 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3894 T278 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8d76e36e0006
[junit4:junit4]   2> 3894 T325 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 3894 T275 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:54021 which had sessionid 0x13b8d76e36e0006
[junit4:junit4]   2> 3894 T273 oaz.ZooKeeper.close Session: 0x13b8d76e36e0006 closed
[junit4:junit4]   2> 3895 T273 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50576/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@1c878cfe
[junit4:junit4]   2> 3896 T326 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:50576. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 3896 T273 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3896 T326 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:50576, initiating session
[junit4:junit4]   2> 3896 T275 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:54022
[junit4:junit4]   2> 3897 T275 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:54022
[junit4:junit4]   2> 3897 T277 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8d76e36e0007 with negotiated timeout 8000 for client /127.0.0.1:54022
[junit4:junit4]   2> 3897 T326 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:50576, sessionid = 0x13b8d76e36e0007, negotiated timeout = 8000
[junit4:junit4]   2> 3897 T327 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c878cfe name:ZooKeeperConnection Watcher:127.0.0.1:50576/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3898 T273 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3898 T278 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d76e36e0007 type:create cxid:0x1 zxid:0x6d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3899 T278 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d76e36e0007 type:create cxid:0x2 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3899 T273 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33795_solr
[junit4:junit4]   2> 3900 T278 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d76e36e0007 type:delete cxid:0x4 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:33795_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:33795_solr
[junit4:junit4]   2> 3900 T273 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:33795_solr
[junit4:junit4]   2> 3901 T295 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3902 T312 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 3902 T312 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 3903 T273 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 3903 T295 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 3903 T273 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 3904 T273 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 3904 T273 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 3904 T273 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 3905 T273 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 3905 T273 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 3905 T273 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 3906 T273 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 3906 T273 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 3911 T273 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3916 T328 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355288080777/collection1
[junit4:junit4]   2> 3916 T328 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 3917 T328 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 3917 T328 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 3918 T328 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355288080777/collection1/'
[junit4:junit4]   2> 3918 T328 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty2-1355288080777/collection1/lib/README' to classloader
[junit4:junit4]   2> 3919 T328 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty2-1355288080777/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 3954 T328 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 4008 T328 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 4009 T328 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 4014 T328 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 4269 T296 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4270 T296 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:56314_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:56314/solr"}
[junit4:junit4]   2> 4272 T295 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4272 T327 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4273 T312 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4492 T328 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 4499 T328 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 4502 T328 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 4511 T328 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 4514 T328 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 4517 T328 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 4518 T328 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 4519 T328 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355288080777/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355288077057/jetty2/
[junit4:junit4]   2> 4519 T328 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c05ec77
[junit4:junit4]   2> 4519 T328 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355288077057/jetty2/index/
[junit4:junit4]   2> 4519 T328 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355288077057/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 4520 T328 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355288077057/jetty2/index forceNew:false
[junit4:junit4]   2> 4523 T328 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355288077057/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1c9e30a0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 4523 T328 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 4524 T328 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 4525 T328 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 4525 T328 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 4525 T328 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 4525 T328 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 4526 T328 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 4526 T328 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 4526 T328 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 4527 T328 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 4528 T328 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 4528 T328 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 4529 T328 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 4529 T328 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 4530 T328 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 4530 T328 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 4531 T328 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 4531 T328 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 4532 T328 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4533 T328 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4534 T328 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4534 T328 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4535 T328 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4536 T328 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4537 T328 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4537 T328 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 4538 T328 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 4540 T328 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 4542 T328 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 4543 T328 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 4545 T328 oass.SolrIndexSearcher.<init> Opening Searcher@1ca33516 main
[junit4:junit4]   2> 4545 T328 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 4546 T328 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 4546 T328 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 4547 T328 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 4551 T328 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 4577 T329 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1ca33516 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 4583 T328 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 4583 T328 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 4776 T296 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4777 T296 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:33795_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:33795/solr"}
[junit4:junit4]   2> 4777 T296 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 4777 T296 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4]   2> 4780 T312 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4780 T295 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4780 T327 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5085 T328 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 5085 T328 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:33795/solr shardId:shard2
[junit4:junit4]   2> 5086 T328 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4]   2> 5089 T278 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d76e36e0007 type:delete cxid:0x44 zxid:0x7e txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard2 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard2
[junit4:junit4]   2> 5089 T328 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 5090 T278 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d76e36e0007 type:create cxid:0x45 zxid:0x7f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5090 T328 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 5091 T328 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 5091 T328 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:33795/solr/collection1/
[junit4:junit4]   2> 5091 T328 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 5091 T328 oasc.SyncStrategy.syncToMe http://127.0.0.1:33795/solr/collection1/ has no replicas
[junit4:junit4]   2> 5091 T328 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:33795/solr/collection1/
[junit4:junit4]   2> 5092 T328 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4]   2> 5093 T278 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d76e36e0007 type:create cxid:0x4e zxid:0x82 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5283 T296 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5287 T312 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5287 T295 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5287 T327 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5295 T328 oasc.ZkController.register We are http://127.0.0.1:33795/solr/collection1/ and leader is http://127.0.0.1:33795/solr/collection1/
[junit4:junit4]   2> 5295 T328 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:33795/solr
[junit4:junit4]   2> 5295 T328 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 5295 T328 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 5295 T328 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 5297 T328 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5298 T273 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 5298 T273 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 5299 T273 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 5355 T273 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 5356 T273 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:59287
[junit4:junit4]   2> 5357 T273 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 5357 T273 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355288082288
[junit4:junit4]   2> 5358 T273 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355288082288/'
[junit4:junit4]   2> 5370 T273 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 5371 T273 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 5371 T273 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355288082288
[junit4:junit4]   2> 5371 T273 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355288082288/solr.xml
[junit4:junit4]   2> 5372 T273 oasc.CoreContainer.<init> New CoreContainer 482985217
[junit4:junit4]   2> 5372 T273 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355288082288/'
[junit4:junit4]   2> 5372 T273 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355288082288/'
[junit4:junit4]   2> 5386 T273 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 5398 T273 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:50576/solr
[junit4:junit4]   2> 5399 T273 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 5399 T273 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50576 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1cd3a43d
[junit4:junit4]   2> 5400 T273 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 5400 T339 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:50576. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 5401 T339 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:50576, initiating session
[junit4:junit4]   2> 5401 T275 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:54023
[junit4:junit4]   2> 5401 T275 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:54023
[junit4:junit4]   2> 5402 T277 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8d76e36e0008 with negotiated timeout 20000 for client /127.0.0.1:54023
[junit4:junit4]   2> 5402 T339 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:50576, sessionid = 0x13b8d76e36e0008, negotiated timeout = 20000
[junit4:junit4]   2> 5402 T340 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1cd3a43d name:ZooKeeperConnection Watcher:127.0.0.1:50576 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 5402 T273 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 5403 T278 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8d76e36e0008
[junit4:junit4]   2> 5403 T340 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 5403 T275 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:54023 which had sessionid 0x13b8d76e36e0008
[junit4:junit4]   2> 5403 T273 oaz.ZooKeeper.close Session: 0x13b8d76e36e0008 closed
[junit4:junit4]   2> 5404 T273 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50576/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@1cd3fe62
[junit4:junit4]   2> 5405 T341 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:50576. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 5405 T273 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 5405 T275 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:54024
[junit4:junit4]   2> 5405 T341 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:50576, initiating session
[junit4:junit4]   2> 5406 T275 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:54024
[junit4:junit4]   2> 5406 T277 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8d76e36e0009 with negotiated timeout 8000 for client /127.0.0.1:54024
[junit4:junit4]   2> 5406 T341 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:50576, sessionid = 0x13b8d76e36e0009, negotiated timeout = 8000
[junit4:junit4]   2> 5407 T342 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1cd3fe62 name:ZooKeeperConnection Watcher:127.0.0.1:50576/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 5407 T273 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 5407 T278 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d76e36e0009 type:create cxid:0x1 zxid:0x8f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5408 T278 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d76e36e0009 type:create cxid:0x2 zxid:0x90 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5409 T273 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59287_solr
[junit4:junit4]   2> 5409 T278 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d76e36e0009 type:delete cxid:0x4 zxid:0x91 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:59287_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:59287_solr
[junit4:junit4]   2> 5410 T273 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59287_solr
[junit4:junit4]   2> 5412 T295 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5412 T327 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5413 T312 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 5413 T312 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5414 T327 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 5413 T273 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 5414 T295 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 5414 T273 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 5414 T273 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 5415 T273 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 5415 T273 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 5415 T273 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 5415 T273 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 5416 T273 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 5416 T273 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 5416 T273 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 5421 T273 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 5427 T343 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355288082288/collection1
[junit4:junit4]   2> 5427 T343 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 5427 T343 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 5427 T343 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 5428 T343 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355288082288/collection1/'
[junit4:junit4]   2> 5428 T343 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty3-1355288082288/collection1/lib/README' to classloader
[junit4:junit4]   2> 5429 T343 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty3-1355288082288/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 5471 T343 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 5526 T343 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 5527 T343 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 5532 T343 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 5791 T296 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5792 T296 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:33795_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:33795/solr"}
[junit4:junit4]   2> 5795 T342 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5795 T327 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5795 T295 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5795 T312 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6042 T343 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 6049 T343 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 6052 T343 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 6065 T343 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 6068 T343 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 6071 T343 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 6072 T343 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 6073 T343 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355288082288/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355288077057/jetty3/
[junit4:junit4]   2> 6073 T343 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c05ec77
[junit4:junit4]   2> 6074 T343 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355288077057/jetty3/index/
[junit4:junit4]   2> 6074 T343 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355288077057/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 6074 T343 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355288077057/jetty3/index forceNew:false
[junit4:junit4]   2> 6078 T343 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355288077057/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1c719cc9),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 6078 T343 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 6078 T343 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 6079 T343 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 6079 T343 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 6080 T343 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 6080 T343 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 6080 T343 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 6080 T343 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 6081 T343 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 6081 T343 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 6082 T343 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 6083 T343 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 6084 T343 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 6084 T343 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 6085 T343 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 6085 T343 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 6085 T343 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 6086 T343 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 6086 T343 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6087 T343 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6088 T343 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6089 T343 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6089 T343 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6090 T343 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6091 T343 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6091 T343 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 6092 T343 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 6094 T343 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 6096 T343 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 6097 T343 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 6099 T343 oass.SolrIndexSearcher.<init> Opening Searcher@1c7af1f9 main
[junit4:junit4]   2> 6099 T343 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 6100 T343 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 6100 T343 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 6101 T343 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 6104 T343 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 6129 T344 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1c7af1f9 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 6136 T343 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 6136 T343 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 6300 T296 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6301 T296 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:59287_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:59287/solr"}
[junit4:junit4]   2> 6301 T296 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 6301 T296 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 6382 T295 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6382 T342 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6382 T312 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6382 T327 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6637 T343 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 6638 T343 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:59287/solr shardId:shard1
[junit4:junit4]   2> 6640 T343 oasc.ZkController.register We are http://127.0.0.1:59287/solr/collection1/ and leader is http://127.0.0.1:56314/solr/collection1/
[junit4:junit4]   2> 6640 T343 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:59287/solr
[junit4:junit4]   2> 6640 T343 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 6641 T343 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> 6644 T343 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> ASYNC  NEW_CORE C50 name=collection1 org.apache.solr.core.SolrCore@1c55fa09 url=http://127.0.0.1:59287/solr/collection1 node=127.0.0.1:59287_solr
[junit4:junit4]   2> 6645 T345 C50 P59287 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 6646 T273 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 6648 T273 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 6649 T273 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 6656 T345 C50 P59287 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 6656 T345 C50 P59287 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 6657 T345 C50 P59287 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 6658 T345 C50 P59287 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:56314/solr/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 6661 T345 C50 P59287 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4]   2> 6667 T345 C50 P59287 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:59287/solr START replicas=[http://127.0.0.1:56314/solr/collection1/] nUpdates=100
[junit4:junit4]   2> 6670 T345 C50 P59287 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 6670 T345 C50 P59287 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 6670 T345 C50 P59287 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 6671 T345 C50 P59287 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C51 name=collection1 org.apache.solr.core.SolrCore@1c5e2602 url=http://127.0.0.1:56314/solr/collection1 node=127.0.0.1:56314_solr
[junit4:junit4]   2> 6702 T307 C51 P56314 REQ /get {distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=0 
[junit4:junit4]   2> 6717 T273 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 6718 T273 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:56959
[junit4:junit4]   2> 6719 T273 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 6719 T273 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355288083640
[junit4:junit4]   2> 6720 T273 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355288083640/'
[junit4:junit4]   2> 6737 T273 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 6737 T273 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 6737 T273 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355288083640
[junit4:junit4]   2> 6738 T273 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355288083640/solr.xml
[junit4:junit4]   2> 6738 T273 oasc.CoreContainer.<init> New CoreContainer 480833827
[junit4:junit4]   2> 6738 T273 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355288083640/'
[junit4:junit4]   2> 6739 T273 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355288083640/'
[junit4:junit4]   2> 6753 T273 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 6767 T273 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:50576/solr
[junit4:junit4]   2> 6767 T273 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 6768 T273 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50576 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1cc2c524
[junit4:junit4]   2> 6768 T273 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6768 T356 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:50576. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 6769 T356 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:50576, initiating session
[junit4:junit4]   2> 6769 T275 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:54029
[junit4:junit4]   2> 6769 T275 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:54029
[junit4:junit4]   2> 6770 T277 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8d76e36e000a with negotiated timeout 20000 for client /127.0.0.1:54029
[junit4:junit4]   2> 6770 T356 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:50576, sessionid = 0x13b8d76e36e000a, negotiated timeout = 20000
[junit4:junit4]   2> 6770 T357 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1cc2c524 name:ZooKeeperConnection Watcher:127.0.0.1:50576 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6771 T273 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6771 T278 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8d76e36e000a
[junit4:junit4]   2> 6772 T357 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 6772 T273 oaz.ZooKeeper.close Session: 0x13b8d76e36e000a closed
[junit4:junit4]   2> 6772 T275 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:54029 which had sessionid 0x13b8d76e36e000a
[junit4:junit4]   2> 6772 T273 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50576/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@1cb72627
[junit4:junit4]   2> 6773 T358 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:50576. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 6773 T273 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6773 T358 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:50576, initiating session
[junit4:junit4]   2> 6773 T275 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:54030
[junit4:junit4]   2> 6774 T275 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:54030
[junit4:junit4]   2> 6774 T277 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8d76e36e000b with negotiated timeout 8000 for client /127.0.0.1:54030
[junit4:junit4]   2> 6774 T358 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:50576, sessionid = 0x13b8d76e36e000b, negotiated timeout = 8000
[junit4:junit4]   2> 6775 T359 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1cb72627 name:ZooKeeperConnection Watcher:127.0.0.1:50576/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6775 T273 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6775 T278 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d76e36e000b type:create cxid:0x1 zxid:0xa2 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6776 T278 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d76e36e000b type:create cxid:0x2 zxid:0xa3 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6776 T273 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56959_solr
[junit4:junit4]   2> 6777 T278 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d76e36e000b type:delete cxid:0x4 zxid:0xa4 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:56959_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:56959_solr
[junit4:junit4]   2> 6777 T273 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56959_solr
[junit4:junit4]   2> 6779 T295 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6779 T327 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6779 T312 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 6779 T342 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 6779 T342 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6779 T312 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6780 T327 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 6780 T295 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 6780 T273 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 6781 T273 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 6782 T273 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 6782 T273 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 6782 T273 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 6783 T273 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 6783 T273 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 6784 T273 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 6784 T273 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 6784 T273 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 6789 T273 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 6795 T360 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355288083640/collection1
[junit4:junit4]   2> 6795 T360 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 6796 T360 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 6796 T360 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 6797 T360 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355288083640/collection1/'
[junit4:junit4]   2> 6797 T360 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty4-1355288083640/collection1/lib/README' to classloader
[junit4:junit4]   2> 6797 T360 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty4-1355288083640/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 6833 T360 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 6886 T296 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6886 T296 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:59287_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:59287/solr"}
[junit4:junit4]   2> 6887 T360 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 6888 T360 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 6890 T359 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6890 T327 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6890 T295 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6890 T312 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6890 T342 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6894 T360 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 7429 T360 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 7436 T360 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 7439 T360 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 7448 T360 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 7451 T360 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 7454 T360 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 7455 T360 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 7456 T360 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355288083640/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355288077057/jetty4/
[junit4:junit4]   2> 7456 T360 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c05ec77
[junit4:junit4]   2> 7457 T360 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355288077057/jetty4/index/
[junit4:junit4]   2> 7457 T360 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355288077057/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 7458 T360 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355288077057/jetty4/index forceNew:false
[junit4:junit4]   2> 7461 T360 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355288077057/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1ce85565),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 7461 T360 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 7461 T360 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 7462 T360 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 7462 T360 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 7463 T360 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 7463 T360 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 7463 T360 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 7463 T360 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 7464 T360 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 7464 T360 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 7465 T360 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 7466 T360 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 7467 T360 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 7467 T360 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 7468 T360 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 7468 T360 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 7468 T360 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 7469 T360 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 7469 T360 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7470 T360 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7471 T360 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7472 T360 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7473 T360 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7474 T360 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7475 T360 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7476 T360 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 7476 T360 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 7478 T360 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 7480 T360 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 7481 T360 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 7483 T360 oass.SolrIndexSearcher.<init> Opening Searcher@1cea52bb main
[junit4:junit4]   2> 7484 T360 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 7484 T360 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 7484 T360 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 7485 T360 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 7488 T360 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 7516 T361 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1cea52bb main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 7526 T360 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 7526 T360 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 7894 T296 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7895 T296 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:56959_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:56959/solr"}
[junit4:junit4]   2> 7895 T296 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 7895 T296 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4]   2> 7898 T312 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7898 T327 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7898 T342 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7898 T359 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7898 T295 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8027 T360 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 8028 T360 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:56959/solr shardId:shard2
[junit4:junit4]   2> 8030 T360 oasc.ZkController.register We are http://127.0.0.1:56959/solr/collection1/ and leader is http://127.0.0.1:33795/solr/collection1/
[junit4:junit4]   2> 8030 T360 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:56959/solr
[junit4:junit4]   2> 8030 T360 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 8030 T360 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C52 name=collection1 org.apache.solr.core.SolrCore@1ce7df65 url=http://127.0.0.1:56959/solr/collection1 node=127.0.0.1:56959_solr
[junit4:junit4]   2> 8031 T362 C52 P56959 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 8031 T362 C52 P56959 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 8031 T360 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8031 T362 C52 P56959 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 8032 T362 C52 P56959 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 8032 T273 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 8032 T362 C52 P56959 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:33795/solr/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 8033 T273 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 8033 T362 C52 P56959 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:56959/solr START replicas=[http://127.0.0.1:33795/solr/collection1/] nUpdates=100
[junit4:junit4]   2> 8033 T273 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 8033 T362 C52 P56959 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 8034 T362 C52 P56959 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 8034 T362 C52 P56959 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 8034 T362 C52 P56959 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 8038 T273 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50576/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1c67179f
[junit4:junit4]   2> 8039 T273 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 8039 T364 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:50576. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 8040 T364 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:50576, initiating session
[junit4:junit4]   2> 8040 T275 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:54035
[junit4:junit4]   2> 8040 T275 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:54035
[junit4:junit4]   2> ASYNC  NEW_CORE C53 name=collection1 org.apache.solr.core.SolrCore@1c9dda9f url=http://127.0.0.1:33795/solr/collection1 node=127.0.0.1:33795_solr
[junit4:junit4]   2> 8041 T320 C53 P33795 REQ /get {distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=0 
[junit4:junit4]   2> 8042 T277 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8d76e36e000c with negotiated timeout 10000 for client /127.0.0.1:54035
[junit4:junit4]   2> 8042 T364 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:50576, sessionid = 0x13b8d76e36e000c, negotiated timeout = 10000
[junit4:junit4]   2> 8043 T365 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c67179f name:ZooKeeperConnection Watcher:127.0.0.1:50576/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 8043 T273 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 8043 T273 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 8046 T273 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 8047 T273 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 8054 T273 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8093 T273 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):540
[junit4:junit4]   2> 8094 T273 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8401 T296 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8402 T296 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:56959_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:56959/solr"}
[junit4:junit4]   2> 8407 T359 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8407 T342 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8407 T312 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8407 T365 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8407 T295 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8408 T327 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9095 T273 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2>  C50_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:59287_solr, base_url=http://127.0.0.1:59287/solr}
[junit4:junit4]   2> 9694 T345 C50 P59287 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 9696 T345 C50 P59287 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 9699 T345 C50 P59287 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:56314/solr/collection1/. core=collection1
[junit4:junit4]   2> 9701 T345 C50 P59287 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 9713 T307 C51 P56314 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16
[junit4:junit4]   2> 9720 T307 C51 P56314 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 9723 T307 C51 P56314 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355288077057/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1c5e7cc4),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 9723 T307 C51 P56314 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 9732 T307 C51 P56314 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355288077057/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1c5e7cc4),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355288077057/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1c5e7cc4),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 9732 T307 C51 P56314 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 9733 T307 C51 P56314 oass.SolrIndexSearcher.<init> Opening Searcher@1c5ff856 realtime
[junit4:junit4]   2> 9733 T307 C51 P56314 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 9734 T307 C51 P56314 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 9741 T307 C51 P56314 /update {waitSearcher=true&openSearcher=false&commit=true&commit_end_point=true&wt=javabin&softCommit=false&version=2} {commit=} 0 33
[junit4:junit4]   2> 9762 T345 C50 P59287 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 9765 T345 C50 P59287 oascsi.HttpClientUtil.createClient Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
[junit4:junit4]   2> 9769 T345 C50 P59287 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 9775 T305 C51 P56314 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 9780 T305 C51 P56314 REQ /replication {command=indexversion&wt=javabin&qt=/replication&version=2} status=0 QTime=5 
[junit4:junit4]   2> 9781 T345 C50 P59287 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 9782 T345 C50 P59287 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 9782 T345 C50 P59287 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 9787 T306 C51 P56314 REQ /replication {command=filelist&generation=2&wt=javabin&qt=/replication&version=2} status=0 QTime=2 
[junit4:junit4]   2> 9788 T345 C50 P59287 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 9790 T345 C50 P59287 oash.SnapPuller.fetchLatestIndex Starting download to ./org.apache.solr.cloud.BasicDistributedZkTest-1355288077057/jetty3/index.20121211215446775 fullCopy=true
[junit4:junit4]   2> 9800 T307 C51 P56314 REQ /replication {file=segments_2&command=filecontent&checksum=true&generation=2&qt=/replication&wt=filestream} status=0 QTime=1 
[junit4:junit4]   2> 9851 T345 C50 P59287 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 9863 T345 C50 P59287 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20121211215446775
[junit4:junit4]   2> 9870 T345 C50 P59287 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.BasicDistributedZkTest-1355288077057/jetty3/index/ new=./org.apache.solr.cloud.BasicDistributedZkTest-1355288077057/jetty3/index.20121211215446775
[junit4:junit4]   2> 9871 T345 C50 P59287 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355288077057/jetty3/index.20121211215446775 forceNew:false
[junit4:junit4]   2> 9872 T345 C50 P59287 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355288077057/jetty3/index.20121211215446775 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1c66a0b6),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 9873 T345 C50 P59287 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 9882 T345 C50 P59287 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 9882 T345 C50 P59287 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 9882 T345 C50 P59287 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4]   2> 9885 T345 C50 P59287 oasc.CachingDirectoryFactory.close Closing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355288077057/jetty3/index.20121211215446775
[junit4:junit4]   2> 9885 T345 C50 P59287 oash.SnapPuller$2.onClose removing old index directory ./org.apache.solr.cloud.BasicDistributedZkTest-1355288077057/jetty3/index
[junit4:junit4]   2> 9887 T345 C50 P59287 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355288077057/jetty3/index.20121211215446775 forceNew:true
[junit4:junit4]   2> 9888 T345 C50 P59287 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355288077057/jetty3/index.20121211215446775 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1c70a854),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 9888 T345 C50 P59287 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 9888 T345 C50 P59287 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 9888 T345 C50 P59287 oass.SolrIndexSearcher.<init> Opening Searcher@1c6f12f1 main
[junit4:junit4]   2> 9889 T345 C50 P59287 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 9890 T344 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1c6f12f1 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 9891 T345 C50 P59287 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 9925 T345 C50 P59287 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355288077057/jetty3/index.20121211215446775 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1c70a854),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355288077057/jetty3/index.20121211215446775 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1c70a854),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 9926 T345 C50 P59287 oasc.SolrDeletionPolicy.updateCommits newest commit = 3
[junit4:junit4]   2> 9929 T345 C50 P59287 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 9931 T345 C50 P59287 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 9932 T345 C50 P59287 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 9932 T345 C50 P59287 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 9932 T345 C50 P59287 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 9934 T345 C50 P59287 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 10097 T273 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10415 T296 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10416 T296 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:59287_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:59287/solr"}
[junit4:junit4]   2> 10420 T359 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10420 T365 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10420 T312 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10420 T327 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10420 T342 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10420 T295 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2>  C52_STATE=coll:collection1 core:collection1 props:{shard=shard2, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:56959_solr, base_url=http://127.0.0.1:56959/solr}
[junit4:junit4]   2> 11038 T362 C52 P56959 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 11039 T362 C52 P56959 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 11039 T362 C52 P56959 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:33795/solr/collection1/. core=collection1
[junit4:junit4]   2> 11039 T362 C52 P56959 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 11047 T320 C53 P33795 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 11051 T320 C53 P33795 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355288077057/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1c9e30a0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 11051 T320 C53 P33795 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 11062 T320 C53 P33795 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355288077057/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1c9e30a0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355288077057/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1c9e30a0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 11062 T320 C53 P33795 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 11063 T320 C53 P33795 oass.SolrIndexSearcher.<init> Opening Searcher@1c6de77f realtime
[junit4:junit4]   2> 11063 T320 C53 P33795 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 11063 T320 C53 P33795 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 11064 T320 C53 P33795 /update {waitSearcher=true&openSearcher=false&commit=true&commit_end_point=true&wt=javabin&softCommit=false&version=2} {commit=} 0 17
[junit4:junit4]   2> 11065 T362 C52 P56959 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 11065 T362 C52 P56959 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 11066 T321 C53 P33795 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 11066 T321 C53 P33795 REQ /replication {command=indexversion&wt=javabin&qt=/replication&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11067 T362 C52 P56959 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 11067 T362 C52 P56959 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 11067 T362 C52 P56959 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 11069 T322 C53 P33795 REQ /replication {command=filelist&generation=2&wt=javabin&qt=/replication&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11069 T362 C52 P56959 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 11069 T362 C52 P56959 oash.SnapPuller.fetchLatestIndex Starting download to ./org.apache.solr.cloud.BasicDistributedZkTest-1355288077057/jetty4/index.20121211215448055 fullCopy=true
[junit4:junit4]   2> 11072 T320 C53 P33795 REQ /replication {file=segments_2&command=filecontent&checksum=true&generation=2&qt=/replication&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 11072 T362 C52 P56959 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 11081 T362 C52 P56959 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20121211215448055
[junit4:junit4]   2> 11082 T362 C52 P56959 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.BasicDistributedZkTest-1355288077057/jetty4/index/ new=./org.apache.solr.cloud.BasicDistributedZkTest-1355288077057/jetty4/index.20121211215448055
[junit4:junit4]   2> 11082 T362 C52 P56959 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355288077057/jetty4/index.20121211215448055 forceNew:false
[junit4:junit4]   2> 11083 T362 C52 P56959 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355288077057/jetty4/index.20121211215448055 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1c6190f3),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 11084 T362 C52 P56959 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 11084 T362 C52 P56959 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 11084 T362 C52 P56959 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 11084 T362 C52 P56959 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4]   2> 11085 T362 C52 P56959 oasc.CachingDirectoryFactory.close Closing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355288077057/jetty4/index.20121211215448055
[junit4:junit4]   2> 11086 T362 C52 P56959 oash.SnapPuller$2.onClose removing old index directory ./org.apache.solr.cloud.BasicDistributedZkTest-1355288077057/jetty4/index
[junit4:junit4]   2> 11087 T362 C52 P56959 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355288077057/jetty4/index.20121211215448055 forceNew:true
[junit4:junit4]   2> 11088 T362 C52 P56959 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355288077057/jetty4/index.20121211215448055 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1c6276ff),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 11089 T362 C52 P56959 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 11089 T362 C52 P56959 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 11090 T362 C52 P56959 oass.SolrIndexSearcher.<init> Opening Searcher@1c631d93 main
[junit4:junit4]   2> 11090 T362 C52 P56959 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 11093 T361 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1c631d93 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 11093 T362 C52 P56959 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 11098 T273 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 11123 T362 C52 P56959 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355288077057/jetty4/index.20121211215448055 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1c6276ff),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355288077057/jetty4/index.20121211215448055 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1c6276ff),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 11124 T362 C52 P56959 oasc.SolrDeletionPolicy.updateCommits newest commit = 3
[junit4:junit4]   2> 11125 T362 C52 P56959 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 11125 T362 C52 P56959 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 11125 T362 C52 P56959 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 11126 T362 C52 P56959 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 11126 T362 C52 P56959 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 11127 T362 C52 P56959 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 11426 T296 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 11427 T296 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:56959_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:56959/solr"}
[junit4:junit4]   2> 11431 T295 oascc.ZkStateReader$2.process A cluster state change has

[...truncated too long message...]

arch -Dtests.seed=75B21CF88F8DEB2F -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=es_BO -Dtests.timezone=Indian/Chagos -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] FAILURE  573s J1 | BasicDistributedZk2Test.testDistribSearch <<<
[junit4:junit4]    > Throwable #1: java.lang.AssertionError: There are still nodes recoverying - waited for 540 seconds
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([75B21CF88F8DEB2F:F45492E0F8D28B13]:0)
[junit4:junit4]    > 	at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:165)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:115)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:110)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:563)
[junit4:junit4]    > 	at org.apache.solr.cloud.BasicDistributedZk2Test.brindDownShardIndexSomeDocsAndRecover(BasicDistributedZk2Test.java:321)
[junit4:junit4]    > 	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:83)
[junit4:junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
[junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:597)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:738)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:774)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:683)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:44)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:56)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:662)
[junit4:junit4]   2> 572603 T556 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> NOTE: test params are: codec=Lucene41: {n_f1=MockFixedIntBlock(blockSize=1616), foo_b=PostingsFormat(name=Asserting), foo_d=PostingsFormat(name=TestBloomFilteredLucene41Postings), foo_f=PostingsFormat(name=Asserting), n_tl1=MockFixedIntBlock(blockSize=1616), n_d1=PostingsFormat(name=Memory doPackFST= true), rnd_b=PostingsFormat(name=TestBloomFilteredLucene41Postings), intDefault=MockFixedIntBlock(blockSize=1616), n_td1=MockFixedIntBlock(blockSize=1616), id=PostingsFormat(name=TestBloomFilteredLucene41Postings), timestamp=PostingsFormat(name=Memory doPackFST= true), range_facet_sl=PostingsFormat(name=TestBloomFilteredLucene41Postings), range_facet_si=PostingsFormat(name=Memory doPackFST= true), oddField_s=PostingsFormat(name=TestBloomFilteredLucene41Postings), multiDefault=PostingsFormat(name=Memory doPackFST= true), n_tf1=PostingsFormat(name=Memory doPackFST= true), n_dt1=MockFixedIntBlock(blockSize=1616), n_ti1=PostingsFormat(name=TestBloomFilteredLucene41Postings), range_facet_l=PostingsFormat(name=Memory doPackFST= true), text=PostingsFormat(name=Asserting), _version_=MockFixedIntBlock(blockSize=1616), SubjectTerms_mfacet=MockFixedIntBlock(blockSize=1616), a_t=PostingsFormat(name=Memory doPackFST= true), n_tdt1=MockFixedIntBlock(blockSize=1616), other_tl1=MockFixedIntBlock(blockSize=1616), n_l1=PostingsFormat(name=Memory doPackFST= true), a_si=MockFixedIntBlock(blockSize=1616)}, sim=RandomSimilarityProvider(queryNorm=false,coord=crazy): {}, locale=es_BO, timezone=Indian/Chagos
[junit4:junit4]   2> NOTE: Linux 3.2.0-34-generic amd64/Oracle Corporation 1.6.0_33 (64-bit)/cpus=8,threads=1,free=280483928,total=536870912
[junit4:junit4]   2> NOTE: All tests run in this JVM: [ShowFileRequestHandlerTest, TestBM25SimilarityFactory, DocumentBuilderTest, QueryParsingTest, ReturnFieldsTest, TestDocSet, RAMDirectoryFactoryTest, TestStressRecovery, TestRecovery, QueryEqualityTest, TimeZoneUtilsTest, TestDFRSimilarityFactory, TestDistributedGrouping, RequiredFieldsTest, SpellingQueryConverterTest, DisMaxRequestHandlerTest, LegacyHTMLStripCharFilterTest, TestSolrXMLSerializer, PathHierarchyTokenizerFactoryTest, TestSolrCoreProperties, TestSort, SyncSliceTest, DirectUpdateHandlerTest, CoreContainerCoreInitFailuresTest, BasicFunctionalityTest, StandardRequestHandlerTest, TestSolrDeletionPolicy2, TestCSVResponseWriter, DOMUtilTest, TestReversedWildcardFilterFactory, PrimUtilsTest, TestHashPartitioner, TestUpdate, TestSolr4Spatial, ClusterStateUpdateTest, BasicDistributedZk2Test]
[junit4:junit4] Completed on J1 in 572.67s, 1 test, 1 failure <<< FAILURES!

[...truncated 81 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:352: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:178: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:438: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1171: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:835: There were test failures: 239 suites, 994 tests, 1 error, 2 failures, 7 ignored (2 assumptions)

Total time: 51 minutes 50 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 64bit/jrockit-jdk1.6.0_33-R28.2.4-4.1.0 -XnoOpt
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-4.x-Linux (32bit/jdk1.7.0_09) - Build # 3175 - Still Failing!

Posted by Policeman Jenkins Server <je...@sd-datasolutions.de>.
Build: http://jenkins.sd-datasolutions.de/job/Lucene-Solr-4.x-Linux/3175/
Java: 32bit/jdk1.7.0_09 -client -XX:+UseParallelGC

3 tests failed.
FAILED:  org.apache.solr.cloud.SyncSliceTest.testDistribSearch

Error Message:
There are still nodes recoverying - waited for 540 seconds

Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 540 seconds
	at __randomizedtesting.SeedInfo.seed([8C2C5FE1A5F7421E:DCAD1F9D2A82222]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:165)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:115)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:110)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:563)
	at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:224)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:601)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)


FAILED:  org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch

Error Message:
There are still nodes recoverying - waited for 540 seconds

Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 540 seconds
	at __randomizedtesting.SeedInfo.seed([8C2C5FE1A5F7421E:DCAD1F9D2A82222]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:165)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:115)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:110)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:563)
	at org.apache.solr.cloud.BasicDistributedZk2Test.brindDownShardIndexSomeDocsAndRecover(BasicDistributedZk2Test.java:321)
	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:83)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:601)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)


FAILED:  org.apache.solr.cloud.BasicDistributedZkTest.testDistribSearch

Error Message:
Server at http://127.0.0.1:42252/solr returned non ok status:500, message:Server Error

Stack Trace:
org.apache.solr.common.SolrException: Server at http://127.0.0.1:42252/solr returned non ok status:500, message:Server Error
	at __randomizedtesting.SeedInfo.seed([8C2C5FE1A5F7421E:DCAD1F9D2A82222]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:372)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
	at org.apache.solr.client.solrj.request.CoreAdminRequest.process(CoreAdminRequest.java:429)
	at org.apache.solr.client.solrj.request.CoreAdminRequest.getStatus(CoreAdminRequest.java:472)
	at org.apache.solr.cloud.BasicDistributedZkTest.collectStartTimes(BasicDistributedZkTest.java:959)
	at org.apache.solr.cloud.BasicDistributedZkTest.testCollectionsAPI(BasicDistributedZkTest.java:795)
	at org.apache.solr.cloud.BasicDistributedZkTest.doTest(BasicDistributedZkTest.java:343)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:601)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)




Build Log:
[...truncated 8631 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZkTest
[junit4:junit4]   2> 3 T767 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZkTest-1355283064155
[junit4:junit4]   2> 4 T767 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 4 T768 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 5 T768 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 5 T768 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4]   2> 5 T768 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4]   2> 6 T768 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 6 T768 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355283064154/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4]   2> 104 T767 oasc.ZkTestServer.run start zk server on port:33453
[junit4:junit4]   2> 105 T767 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33453 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@cf945
[junit4:junit4]   2> 106 T773 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33453. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 106 T767 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 106 T773 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33453, initiating session
[junit4:junit4]   2> 107 T769 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:54193
[junit4:junit4]   2> 107 T769 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:54193
[junit4:junit4]   2> 107 T771 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 427 T771 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8d2a655e0000 with negotiated timeout 10000 for client /127.0.0.1:54193
[junit4:junit4]   2> 427 T773 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33453, sessionid = 0x13b8d2a655e0000, negotiated timeout = 10000
[junit4:junit4]   2> 427 T774 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@cf945 name:ZooKeeperConnection Watcher:127.0.0.1:33453 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 427 T767 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 428 T767 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 431 T772 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8d2a655e0000
[junit4:junit4]   2> 432 T774 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 432 T769 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:54193 which had sessionid 0x13b8d2a655e0000
[junit4:junit4]   2> 432 T767 oaz.ZooKeeper.close Session: 0x13b8d2a655e0000 closed
[junit4:junit4]   2> 433 T767 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33453/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@2ad23f
[junit4:junit4]   2> 435 T775 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33453. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 434 T767 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 435 T775 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33453, initiating session
[junit4:junit4]   2> 435 T769 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:54194
[junit4:junit4]   2> 436 T769 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:54194
[junit4:junit4]   2> 437 T771 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8d2a655e0001 with negotiated timeout 10000 for client /127.0.0.1:54194
[junit4:junit4]   2> 437 T775 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33453, sessionid = 0x13b8d2a655e0001, negotiated timeout = 10000
[junit4:junit4]   2> 438 T776 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2ad23f name:ZooKeeperConnection Watcher:127.0.0.1:33453/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 438 T767 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 439 T767 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 444 T767 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 447 T767 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 450 T767 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 454 T767 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 455 T767 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 461 T767 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 463 T767 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 467 T767 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 468 T767 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 472 T767 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 473 T767 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 476 T767 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 477 T767 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 478 T767 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 479 T767 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 480 T767 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 481 T767 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 482 T767 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 483 T767 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 485 T767 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 485 T767 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 487 T767 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 487 T767 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 489 T772 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8d2a655e0001
[junit4:junit4]   2> 489 T776 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 489 T769 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:54194 which had sessionid 0x13b8d2a655e0001
[junit4:junit4]   2> 489 T767 oaz.ZooKeeper.close Session: 0x13b8d2a655e0001 closed
[junit4:junit4]   2> 544 T767 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 550 T767 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:41150
[junit4:junit4]   2> 552 T767 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 553 T767 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355283064641
[junit4:junit4]   2> 553 T767 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355283064641/'
[junit4:junit4]   2> 566 T767 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 567 T767 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 567 T767 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355283064641
[junit4:junit4]   2> 567 T767 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355283064641/solr.xml
[junit4:junit4]   2> 568 T767 oasc.CoreContainer.<init> New CoreContainer 32222786
[junit4:junit4]   2> 568 T767 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355283064641/'
[junit4:junit4]   2> 569 T767 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355283064641/'
[junit4:junit4]   2> 583 T767 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 593 T767 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:33453/solr
[junit4:junit4]   2> 594 T767 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 595 T767 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33453 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1f9aede
[junit4:junit4]   2> 596 T786 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33453. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 596 T767 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 596 T786 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33453, initiating session
[junit4:junit4]   2> 596 T769 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:54195
[junit4:junit4]   2> 597 T769 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:54195
[junit4:junit4]   2> 597 T771 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8d2a655e0002 with negotiated timeout 20000 for client /127.0.0.1:54195
[junit4:junit4]   2> 597 T786 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33453, sessionid = 0x13b8d2a655e0002, negotiated timeout = 20000
[junit4:junit4]   2> 598 T787 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f9aede name:ZooKeeperConnection Watcher:127.0.0.1:33453 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 598 T767 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 599 T772 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8d2a655e0002
[junit4:junit4]   2> 599 T787 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 599 T769 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:54195 which had sessionid 0x13b8d2a655e0002
[junit4:junit4]   2> 599 T767 oaz.ZooKeeper.close Session: 0x13b8d2a655e0002 closed
[junit4:junit4]   2> 600 T767 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33453/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@9f40a3
[junit4:junit4]   2> 601 T788 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33453. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 601 T767 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 601 T788 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33453, initiating session
[junit4:junit4]   2> 601 T769 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:54196
[junit4:junit4]   2> 602 T769 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:54196
[junit4:junit4]   2> 602 T771 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8d2a655e0003 with negotiated timeout 8000 for client /127.0.0.1:54196
[junit4:junit4]   2> 602 T788 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33453, sessionid = 0x13b8d2a655e0003, negotiated timeout = 8000
[junit4:junit4]   2> 602 T789 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@9f40a3 name:ZooKeeperConnection Watcher:127.0.0.1:33453/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 603 T767 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 604 T772 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d2a655e0003 type:create cxid:0x2 zxid:0x1b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 604 T767 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 606 T767 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41150_solr
[junit4:junit4]   2> 606 T772 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d2a655e0003 type:delete cxid:0x7 zxid:0x1d txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:41150_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:41150_solr
[junit4:junit4]   2> 607 T767 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:41150_solr
[junit4:junit4]   2> 608 T767 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 609 T767 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 609 T767 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 609 T767 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 610 T767 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 610 T767 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 610 T767 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 611 T767 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 611 T767 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 612 T767 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 623 T767 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 628 T772 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d2a655e0003 type:delete cxid:0x15 zxid:0x22 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 628 T767 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 630 T767 oasc.Overseer.start Overseer (id=88819830892658691-127.0.0.1:41150_solr-n_0000000000) starting
[junit4:junit4]   2> 630 T772 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d2a655e0003 type:create cxid:0x1a zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 631 T772 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d2a655e0003 type:create cxid:0x1b zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 631 T772 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d2a655e0003 type:create cxid:0x1c zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 632 T772 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d2a655e0003 type:create cxid:0x1d zxid:0x27 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 633 T791 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
[junit4:junit4]   2> 633 T767 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 635 T767 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 636 T790 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 640 T792 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355283064641/collection1
[junit4:junit4]   2> 640 T792 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4]   2> 640 T792 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 640 T792 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4]   2> 641 T792 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355283064641/collection1/'
[junit4:junit4]   2> 642 T792 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355283064641/collection1/lib/README' to classloader
[junit4:junit4]   2> 642 T792 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355283064641/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 674 T792 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 720 T792 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 720 T792 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 725 T792 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 1099 T792 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 1105 T792 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 1108 T792 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 1116 T792 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1119 T792 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1122 T792 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1123 T792 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1124 T792 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355283064641/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355283064154/control/data/
[junit4:junit4]   2> 1124 T792 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@12f7719
[junit4:junit4]   2> 1124 T792 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355283064154/control/data/index/
[junit4:junit4]   2> 1125 T792 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355283064154/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 1125 T792 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355283064154/control/data/index forceNew:false
[junit4:junit4]   2> 1128 T792 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355283064154/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@16e6221; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 1129 T792 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 1129 T792 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 1130 T792 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 1130 T792 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 1131 T792 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 1131 T792 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 1131 T792 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 1132 T792 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 1132 T792 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 1132 T792 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 1133 T792 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 1134 T792 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 1134 T792 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 1135 T792 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 1135 T792 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 1135 T792 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 1136 T792 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 1136 T792 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 1137 T792 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1137 T792 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1138 T792 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1139 T792 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1139 T792 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1140 T792 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1141 T792 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1141 T792 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 1142 T792 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 1144 T792 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 1146 T792 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 1147 T792 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 1149 T792 oass.SolrIndexSearcher.<init> Opening Searcher@1ac34e2 main
[junit4:junit4]   2> 1149 T792 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 1150 T792 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 1150 T792 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 1151 T792 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 1155 T792 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 1174 T793 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1ac34e2 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 1178 T792 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 1178 T792 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 1179 T772 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d2a655e0003 type:create cxid:0x53 zxid:0x2a txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 1180 T792 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 1180 T792 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:41150/solr shardId:control_shard
[junit4:junit4]   2> 1181 T792 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/control_shard/election
[junit4:junit4]   2> 1184 T772 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d2a655e0003 type:delete cxid:0x62 zxid:0x31 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4]   2> 1185 T792 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 1185 T772 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d2a655e0003 type:create cxid:0x63 zxid:0x32 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1639 T790 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 1640 T790 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":"control_shard",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:41150_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:41150/solr"}
[junit4:junit4]   2> 1641 T772 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d2a655e0003 type:create cxid:0x6a zxid:0x34 txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 1646 T789 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 1686 T792 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 1687 T792 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 1687 T792 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:41150/solr/collection1/
[junit4:junit4]   2> 1687 T792 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 1688 T792 oasc.SyncStrategy.syncToMe http://127.0.0.1:41150/solr/collection1/ has no replicas
[junit4:junit4]   2> 1688 T792 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:41150/solr/collection1/
[junit4:junit4]   2> 1688 T792 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/control_shard
[junit4:junit4]   2> 1691 T772 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d2a655e0003 type:create cxid:0x89 zxid:0x3f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2149 T790 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2152 T789 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 2193 T792 oasc.ZkController.register We are http://127.0.0.1:41150/solr/collection1/ and leader is http://127.0.0.1:41150/solr/collection1/
[junit4:junit4]   2> 2194 T792 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:41150/solr
[junit4:junit4]   2> 2194 T792 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 2194 T792 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 2194 T792 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 2197 T792 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2198 T767 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 2199 T767 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 2199 T767 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 2252 T767 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 2254 T767 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:57048
[junit4:junit4]   2> 2255 T767 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 2255 T767 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355283066353
[junit4:junit4]   2> 2256 T767 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355283066353/'
[junit4:junit4]   2> 2268 T767 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 2269 T767 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 2269 T767 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355283066353
[junit4:junit4]   2> 2269 T767 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355283066353/solr.xml
[junit4:junit4]   2> 2270 T767 oasc.CoreContainer.<init> New CoreContainer 12709373
[junit4:junit4]   2> 2270 T767 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355283066353/'
[junit4:junit4]   2> 2270 T767 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355283066353/'
[junit4:junit4]   2> 2284 T767 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 2294 T767 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:33453/solr
[junit4:junit4]   2> 2294 T767 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 2295 T767 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33453 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@361df9
[junit4:junit4]   2> 2296 T803 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33453. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 2295 T767 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2296 T803 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33453, initiating session
[junit4:junit4]   2> 2296 T769 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:54197
[junit4:junit4]   2> 2297 T769 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:54197
[junit4:junit4]   2> 2297 T771 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8d2a655e0004 with negotiated timeout 20000 for client /127.0.0.1:54197
[junit4:junit4]   2> 2297 T803 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33453, sessionid = 0x13b8d2a655e0004, negotiated timeout = 20000
[junit4:junit4]   2> 2298 T804 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@361df9 name:ZooKeeperConnection Watcher:127.0.0.1:33453 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2298 T767 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2299 T772 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8d2a655e0004
[junit4:junit4]   2> 2299 T804 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 2299 T769 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:54197 which had sessionid 0x13b8d2a655e0004
[junit4:junit4]   2> 2299 T767 oaz.ZooKeeper.close Session: 0x13b8d2a655e0004 closed
[junit4:junit4]   2> 2300 T767 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33453/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@163ab71
[junit4:junit4]   2> 2301 T805 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33453. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 2301 T767 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2301 T769 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:54198
[junit4:junit4]   2> 2301 T805 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33453, initiating session
[junit4:junit4]   2> 2302 T769 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:54198
[junit4:junit4]   2> 2302 T771 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8d2a655e0005 with negotiated timeout 8000 for client /127.0.0.1:54198
[junit4:junit4]   2> 2302 T805 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33453, sessionid = 0x13b8d2a655e0005, negotiated timeout = 8000
[junit4:junit4]   2> 2303 T806 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@163ab71 name:ZooKeeperConnection Watcher:127.0.0.1:33453/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2303 T767 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2304 T772 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d2a655e0005 type:create cxid:0x1 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2305 T772 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d2a655e0005 type:create cxid:0x2 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2306 T767 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57048_solr
[junit4:junit4]   2> 2306 T772 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d2a655e0005 type:delete cxid:0x4 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:57048_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:57048_solr
[junit4:junit4]   2> 2307 T767 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:57048_solr
[junit4:junit4]   2> 2308 T789 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 2309 T767 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 2310 T789 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 2310 T767 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 2310 T767 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 2311 T767 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 2311 T767 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 2312 T767 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 2312 T767 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 2312 T767 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 2313 T767 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 2313 T767 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 2318 T767 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 2323 T807 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355283066353/collection1
[junit4:junit4]   2> 2323 T807 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 2324 T807 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 2324 T807 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 2325 T807 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355283066353/collection1/'
[junit4:junit4]   2> 2326 T807 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty1-1355283066353/collection1/lib/README' to classloader
[junit4:junit4]   2> 2326 T807 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty1-1355283066353/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 2357 T807 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 2401 T807 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 2402 T807 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 2406 T807 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 2654 T790 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2655 T790 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":"control_shard",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:41150_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:41150/solr"}
[junit4:junit4]   2> 2658 T806 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 2658 T789 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 2789 T807 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 2794 T807 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 2797 T807 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 2807 T807 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 2810 T807 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 2813 T807 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 2814 T807 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 2815 T807 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355283066353/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355283064154/jetty1/
[junit4:junit4]   2> 2815 T807 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@12f7719
[junit4:junit4]   2> 2816 T807 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355283064154/jetty1/index/
[junit4:junit4]   2> 2816 T807 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355283064154/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 2816 T807 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355283064154/jetty1/index forceNew:false
[junit4:junit4]   2> 2820 T807 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355283064154/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@59f2ee; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 2820 T807 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 2821 T807 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 2822 T807 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 2822 T807 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 2823 T807 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 2823 T807 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 2823 T807 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 2823 T807 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 2824 T807 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 2825 T807 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 2825 T807 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 2826 T807 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 2827 T807 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 2827 T807 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 2828 T807 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 2828 T807 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 2828 T807 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 2829 T807 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 2830 T807 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2830 T807 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2831 T807 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2832 T807 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2832 T807 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2833 T807 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2834 T807 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2835 T807 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 2835 T807 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 2838 T807 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 2840 T807 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 2841 T807 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 2843 T807 oass.SolrIndexSearcher.<init> Opening Searcher@148d453 main
[junit4:junit4]   2> 2843 T807 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 2844 T807 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 2844 T807 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 2845 T807 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 2848 T807 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 2872 T808 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@148d453 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 2878 T807 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 2878 T807 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 3162 T790 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3162 T790 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:57048_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:57048/solr"}
[junit4:junit4]   2> 3163 T790 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4]   2> 3164 T790 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 3167 T806 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3167 T789 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3380 T807 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 3380 T807 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:57048/solr shardId:shard1
[junit4:junit4]   2> 3381 T807 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 3389 T772 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d2a655e0005 type:delete cxid:0x45 zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 3390 T807 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 3390 T772 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d2a655e0005 type:create cxid:0x46 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3392 T807 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 3392 T807 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 3392 T807 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:57048/solr/collection1/
[junit4:junit4]   2> 3392 T807 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 3392 T807 oasc.SyncStrategy.syncToMe http://127.0.0.1:57048/solr/collection1/ has no replicas
[junit4:junit4]   2> 3393 T807 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:57048/solr/collection1/
[junit4:junit4]   2> 3393 T807 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 3396 T772 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d2a655e0005 type:create cxid:0x50 zxid:0x60 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3670 T790 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3677 T806 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3677 T789 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3698 T807 oasc.ZkController.register We are http://127.0.0.1:57048/solr/collection1/ and leader is http://127.0.0.1:57048/solr/collection1/
[junit4:junit4]   2> 3699 T807 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:57048/solr
[junit4:junit4]   2> 3699 T807 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 3699 T807 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 3699 T807 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 3700 T807 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3701 T767 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 3701 T767 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 3702 T767 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 3757 T767 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 3759 T767 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:38213
[junit4:junit4]   2> 3760 T767 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 3760 T767 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355283067856
[junit4:junit4]   2> 3761 T767 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355283067856/'
[junit4:junit4]   2> 3773 T767 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 3774 T767 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 3774 T767 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355283067856
[junit4:junit4]   2> 3775 T767 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355283067856/solr.xml
[junit4:junit4]   2> 3775 T767 oasc.CoreContainer.<init> New CoreContainer 15625565
[junit4:junit4]   2> 3775 T767 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355283067856/'
[junit4:junit4]   2> 3776 T767 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355283067856/'
[junit4:junit4]   2> 3789 T767 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 3799 T767 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:33453/solr
[junit4:junit4]   2> 3799 T767 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 3800 T767 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33453 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1154792
[junit4:junit4]   2> 3801 T818 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33453. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 3801 T767 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3801 T818 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33453, initiating session
[junit4:junit4]   2> 3801 T769 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:54199
[junit4:junit4]   2> 3802 T769 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:54199
[junit4:junit4]   2> 3802 T771 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8d2a655e0006 with negotiated timeout 20000 for client /127.0.0.1:54199
[junit4:junit4]   2> 3802 T818 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33453, sessionid = 0x13b8d2a655e0006, negotiated timeout = 20000
[junit4:junit4]   2> 3803 T819 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1154792 name:ZooKeeperConnection Watcher:127.0.0.1:33453 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3803 T767 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3804 T772 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8d2a655e0006
[junit4:junit4]   2> 3804 T819 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 3804 T769 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:54199 which had sessionid 0x13b8d2a655e0006
[junit4:junit4]   2> 3804 T767 oaz.ZooKeeper.close Session: 0x13b8d2a655e0006 closed
[junit4:junit4]   2> 3805 T767 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33453/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@1b82a5a
[junit4:junit4]   2> 3806 T820 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33453. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 3806 T767 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3806 T820 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33453, initiating session
[junit4:junit4]   2> 3806 T769 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:54200
[junit4:junit4]   2> 3806 T769 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:54200
[junit4:junit4]   2> 3807 T771 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8d2a655e0007 with negotiated timeout 8000 for client /127.0.0.1:54200
[junit4:junit4]   2> 3807 T820 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33453, sessionid = 0x13b8d2a655e0007, negotiated timeout = 8000
[junit4:junit4]   2> 3807 T821 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b82a5a name:ZooKeeperConnection Watcher:127.0.0.1:33453/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3807 T767 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3808 T772 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d2a655e0007 type:create cxid:0x1 zxid:0x6d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3809 T772 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d2a655e0007 type:create cxid:0x2 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3810 T767 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38213_solr
[junit4:junit4]   2> 3810 T772 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d2a655e0007 type:delete cxid:0x4 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:38213_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:38213_solr
[junit4:junit4]   2> 3811 T767 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:38213_solr
[junit4:junit4]   2> 3812 T789 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3812 T806 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 3812 T806 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 3812 T767 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 3813 T789 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 3813 T767 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 3814 T767 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 3814 T767 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 3814 T767 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 3815 T767 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 3815 T767 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 3816 T767 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 3816 T767 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 3816 T767 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 3821 T767 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3826 T822 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355283067856/collection1
[junit4:junit4]   2> 3826 T822 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 3827 T822 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 3827 T822 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 3828 T822 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355283067856/collection1/'
[junit4:junit4]   2> 3828 T822 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty2-1355283067856/collection1/lib/README' to classloader
[junit4:junit4]   2> 3828 T822 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty2-1355283067856/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 3859 T822 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 3903 T822 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 3904 T822 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 3909 T822 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 4180 T790 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4181 T790 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:57048_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:57048/solr"}
[junit4:junit4]   2> 4183 T821 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4183 T806 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4183 T789 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4293 T822 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 4299 T822 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 4301 T822 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 4310 T822 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 4313 T822 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 4316 T822 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 4316 T822 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 4317 T822 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355283067856/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355283064154/jetty2/
[junit4:junit4]   2> 4317 T822 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@12f7719
[junit4:junit4]   2> 4318 T822 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355283064154/jetty2/index/
[junit4:junit4]   2> 4318 T822 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355283064154/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 4319 T822 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355283064154/jetty2/index forceNew:false
[junit4:junit4]   2> 4322 T822 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355283064154/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1661095; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 4322 T822 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 4323 T822 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 4324 T822 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 4324 T822 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 4325 T822 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 4325 T822 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 4325 T822 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 4326 T822 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 4326 T822 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 4327 T822 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 4327 T822 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 4328 T822 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 4329 T822 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 4329 T822 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 4330 T822 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 4330 T822 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 4330 T822 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 4331 T822 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 4332 T822 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4332 T822 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4333 T822 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4334 T822 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4334 T822 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4335 T822 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4336 T822 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4337 T822 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 4337 T822 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 4340 T822 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 4341 T822 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 4343 T822 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 4345 T822 oass.SolrIndexSearcher.<init> Opening Searcher@1c486a7 main
[junit4:junit4]   2> 4345 T822 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 4345 T822 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 4346 T822 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 4346 T822 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 4349 T822 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 4370 T823 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1c486a7 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 4379 T822 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 4379 T822 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 4686 T790 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4687 T790 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:38213_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:38213/solr"}
[junit4:junit4]   2> 4687 T790 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 4688 T790 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4]   2> 4691 T821 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4691 T789 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4691 T806 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4881 T822 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 4881 T822 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:38213/solr shardId:shard2
[junit4:junit4]   2> 4882 T822 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4]   2> 4886 T772 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d2a655e0007 type:delete cxid:0x44 zxid:0x7e txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard2 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard2
[junit4:junit4]   2> 4886 T822 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 4886 T772 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d2a655e0007 type:create cxid:0x45 zxid:0x7f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4888 T822 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 4888 T822 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 4888 T822 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:38213/solr/collection1/
[junit4:junit4]   2> 4888 T822 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 4888 T822 oasc.SyncStrategy.syncToMe http://127.0.0.1:38213/solr/collection1/ has no replicas
[junit4:junit4]   2> 4889 T822 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:38213/solr/collection1/
[junit4:junit4]   2> 4889 T822 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4]   2> 4891 T772 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d2a655e0007 type:create cxid:0x4e zxid:0x82 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5196 T790 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5203 T806 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5203 T789 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5203 T821 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5243 T822 oasc.ZkController.register We are http://127.0.0.1:38213/solr/collection1/ and leader is http://127.0.0.1:38213/solr/collection1/
[junit4:junit4]   2> 5243 T822 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:38213/solr
[junit4:junit4]   2> 5243 T822 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 5243 T822 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 5244 T822 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 5245 T822 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5246 T767 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 5246 T767 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 5247 T767 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 5301 T767 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 5303 T767 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:45437
[junit4:junit4]   2> 5303 T767 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 5304 T767 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355283069401
[junit4:junit4]   2> 5304 T767 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355283069401/'
[junit4:junit4]   2> 5317 T767 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 5317 T767 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 5317 T767 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355283069401
[junit4:junit4]   2> 5318 T767 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355283069401/solr.xml
[junit4:junit4]   2> 5318 T767 oasc.CoreContainer.<init> New CoreContainer 30802849
[junit4:junit4]   2> 5319 T767 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355283069401/'
[junit4:junit4]   2> 5319 T767 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355283069401/'
[junit4:junit4]   2> 5340 T767 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 5350 T767 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:33453/solr
[junit4:junit4]   2> 5350 T767 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 5351 T767 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33453 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@92b020
[junit4:junit4]   2> 5352 T833 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33453. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 5352 T767 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 5352 T833 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33453, initiating session
[junit4:junit4]   2> 5353 T769 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:54201
[junit4:junit4]   2> 5353 T769 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:54201
[junit4:junit4]   2> 5354 T771 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8d2a655e0008 with negotiated timeout 20000 for client /127.0.0.1:54201
[junit4:junit4]   2> 5354 T833 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33453, sessionid = 0x13b8d2a655e0008, negotiated timeout = 20000
[junit4:junit4]   2> 5354 T834 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@92b020 name:ZooKeeperConnection Watcher:127.0.0.1:33453 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 5354 T767 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 5355 T772 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8d2a655e0008
[junit4:junit4]   2> 5356 T834 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 5356 T769 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:54201 which had sessionid 0x13b8d2a655e0008
[junit4:junit4]   2> 5356 T767 oaz.ZooKeeper.close Session: 0x13b8d2a655e0008 closed
[junit4:junit4]   2> 5357 T767 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33453/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@72fdaa
[junit4:junit4]   2> 5357 T835 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33453. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 5357 T767 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 5358 T835 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33453, initiating session
[junit4:junit4]   2> 5358 T769 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:54202
[junit4:junit4]   2> 5358 T769 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:54202
[junit4:junit4]   2> 5358 T771 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8d2a655e0009 with negotiated timeout 8000 for client /127.0.0.1:54202
[junit4:junit4]   2> 5359 T835 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33453, sessionid = 0x13b8d2a655e0009, negotiated timeout = 8000
[junit4:junit4]   2> 5359 T836 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@72fdaa name:ZooKeeperConnection Watcher:127.0.0.1:33453/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 5359 T767 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 5360 T772 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d2a655e0009 type:create cxid:0x1 zxid:0x8f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5360 T772 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d2a655e0009 type:create cxid:0x2 zxid:0x90 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5361 T767 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45437_solr
[junit4:junit4]   2> 5362 T772 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d2a655e0009 type:delete cxid:0x4 zxid:0x91 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:45437_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:45437_solr
[junit4:junit4]   2> 5362 T767 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:45437_solr
[junit4:junit4]   2> 5364 T789 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5364 T821 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 5364 T806 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 5364 T821 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5364 T806 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5365 T789 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 5365 T767 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 5366 T767 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 5366 T767 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 5367 T767 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 5368 T767 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 5368 T767 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 5369 T767 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 5370 T767 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 5370 T767 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 5371 T767 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 5377 T767 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 5383 T837 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355283069401/collection1
[junit4:junit4]   2> 5383 T837 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 5383 T837 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 5384 T837 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 5384 T837 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355283069401/collection1/'
[junit4:junit4]   2> 5385 T837 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty3-1355283069401/collection1/lib/README' to classloader
[junit4:junit4]   2> 5385 T837 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty3-1355283069401/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 5416 T837 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 5460 T837 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 5461 T837 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 5465 T837 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 5707 T790 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5707 T790 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:38213_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:38213/solr"}
[junit4:junit4]   2> 5710 T789 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5710 T806 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5711 T836 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5711 T821 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5839 T837 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 5845 T837 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 5848 T837 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 5857 T837 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5860 T837 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5863 T837 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5864 T837 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5865 T837 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355283069401/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355283064154/jetty3/
[junit4:junit4]   2> 5865 T837 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@12f7719
[junit4:junit4]   2> 5865 T837 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355283064154/jetty3/index/
[junit4:junit4]   2> 5866 T837 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355283064154/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 5866 T837 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355283064154/jetty3/index forceNew:false
[junit4:junit4]   2> 5870 T837 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355283064154/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1d77626; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 5870 T837 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 5870 T837 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 5872 T837 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 5872 T837 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 5872 T837 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 5872 T837 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 5873 T837 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 5873 T837 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 5873 T837 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 5874 T837 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 5875 T837 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 5875 T837 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 5876 T837 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 5876 T837 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 5877 T837 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 5877 T837 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 5877 T837 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 5878 T837 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 5879 T837 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5879 T837 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5880 T837 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5881 T837 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5881 T837 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5882 T837 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5883 T837 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5883 T837 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 5884 T837 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 5886 T837 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 5888 T837 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 5889 T837 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 5891 T837 oass.SolrIndexSearcher.<init> Opening Searcher@9fe705 main
[junit4:junit4]   2> 5891 T837 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 5892 T837 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 5892 T837 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 5892 T837 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 5895 T837 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 5915 T838 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@9fe705 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 5921 T837 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 5921 T837 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 6214 T790 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6214 T790 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:45437_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:45437/solr"}
[junit4:junit4]   2> 6214 T790 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 6215 T790 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 6219 T789 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6219 T806 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6219 T836 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6219 T821 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6422 T837 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 6422 T837 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:45437/solr shardId:shard1
[junit4:junit4]   2> 6424 T837 oasc.ZkController.register We are http://127.0.0.1:45437/solr/collection1/ and leader is http://127.0.0.1:57048/solr/collection1/
[junit4:junit4]   2> 6425 T837 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:45437/solr
[junit4:junit4]   2> 6425 T837 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 6425 T837 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C25 name=collection1 org.apache.solr.core.SolrCore@1fef229 url=http://127.0.0.1:45437/solr/collection1 node=127.0.0.1:45437_solr
[junit4:junit4]   2> 6428 T839 C25 P45437 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 6428 T837 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6429 T839 C25 P45437 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 6429 T839 C25 P45437 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 6429 T839 C25 P45437 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 6429 T767 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 6430 T839 C25 P45437 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:57048/solr/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 6430 T767 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 6431 T767 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 6434 T839 C25 P45437 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4]   2> 6440 T839 C25 P45437 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:45437/solr START replicas=[http://127.0.0.1:57048/solr/collection1/] nUpdates=100
[junit4:junit4]   2> 6440 T839 C25 P45437 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 6441 T839 C25 P45437 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 6441 T839 C25 P45437 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 6441 T839 C25 P45437 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C26 name=collection1 org.apache.solr.core.SolrCore@1308cc2 url=http://127.0.0.1:57048/solr/collection1 node=127.0.0.1:57048_solr
[junit4:junit4]   2> 6445 T799 C26 P57048 REQ /get {distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=0 
[junit4:junit4]   2> 6495 T767 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 6497 T767 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:42252
[junit4:junit4]   2> 6497 T767 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 6498 T767 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355283070586
[junit4:junit4]   2> 6498 T767 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355283070586/'
[junit4:junit4]   2> 6510 T767 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 6511 T767 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 6511 T767 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355283070586
[junit4:junit4]   2> 6512 T767 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355283070586/solr.xml
[junit4:junit4]   2> 6512 T767 oasc.CoreContainer.<init> New CoreContainer 17477667
[junit4:junit4]   2> 6513 T767 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355283070586/'
[junit4:junit4]   2> 6513 T767 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355283070586/'
[junit4:junit4]   2> 6526 T767 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 6536 T767 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:33453/solr
[junit4:junit4]   2> 6537 T767 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 6537 T767 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33453 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@5af5a8
[junit4:junit4]   2> 6538 T850 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33453. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 6538 T767 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6539 T850 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33453, initiating session
[junit4:junit4]   2> 6539 T769 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:54206
[junit4:junit4]   2> 6539 T769 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:54206
[junit4:junit4]   2> 6540 T850 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33453, sessionid = 0x13b8d2a655e000a, negotiated timeout = 20000
[junit4:junit4]   2> 6540 T771 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8d2a655e000a with negotiated timeout 20000 for client /127.0.0.1:54206
[junit4:junit4]   2> 6540 T851 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5af5a8 name:ZooKeeperConnection Watcher:127.0.0.1:33453 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6540 T767 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6541 T772 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8d2a655e000a
[junit4:junit4]   2> 6542 T851 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 6542 T769 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:54206 which had sessionid 0x13b8d2a655e000a
[junit4:junit4]   2> 6542 T767 oaz.ZooKeeper.close Session: 0x13b8d2a655e000a closed
[junit4:junit4]   2> 6543 T767 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33453/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@1335e24
[junit4:junit4]   2> 6544 T852 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33453. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 6544 T767 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6544 T852 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33453, initiating session
[junit4:junit4]   2> 6544 T769 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:54207
[junit4:junit4]   2> 6545 T769 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:54207
[junit4:junit4]   2> 6545 T771 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8d2a655e000b with negotiated timeout 8000 for client /127.0.0.1:54207
[junit4:junit4]   2> 6545 T852 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33453, sessionid = 0x13b8d2a655e000b, negotiated timeout = 8000
[junit4:junit4]   2> 6546 T853 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1335e24 name:ZooKeeperConnection Watcher:127.0.0.1:33453/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6546 T767 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6547 T772 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d2a655e000b type:create cxid:0x1 zxid:0xa2 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6548 T772 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d2a655e000b type:create cxid:0x2 zxid:0xa3 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6548 T767 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42252_solr
[junit4:junit4]   2> 6549 T772 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8d2a655e000b type:delete cxid:0x4 zxid:0xa4 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:42252_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:42252_solr
[junit4:junit4]   2> 6550 T767 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:42252_solr
[junit4:junit4]   2> 6551 T789 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6551 T821 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 6552 T806 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 6552 T821 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6552 T806 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6552 T836 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 6552 T836 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6553 T789 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 6553 T767 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 6553 T767 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 6554 T767 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 6554 T767 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 6555 T767 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 6555 T767 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 6556 T767 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 6556 T767 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 6556 T767 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 6557 T767 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 6562 T767 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 6567 T854 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355283070586/collection1
[junit4:junit4]   2> 6567 T854 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 6568 T854 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 6568 T854 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 6569 T854 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355283070586/collection1/'
[junit4:junit4]   2> 6569 T854 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty4-1355283070586/collection1/lib/README' to classloader
[junit4:junit4]   2> 6569 T854 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty4-1355283070586/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 6600 T854 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 6644 T854 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 6645 T854 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 6650 T854 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 6721 T790 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6722 T790 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:45437_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:45437/solr"}
[junit4:junit4]   2> 6725 T821 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6725 T853 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6725 T789 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6725 T806 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6725 T836 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7028 T854 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 7034 T854 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 7037 T854 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 7045 T854 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 7048 T854 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 7051 T854 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 7053 T854 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 7053 T854 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355283070586/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355283064154/jetty4/
[junit4:junit4]   2> 7054 T854 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@12f7719
[junit4:junit4]   2> 7054 T854 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355283064154/jetty4/index/
[junit4:junit4]   2> 7055 T854 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355283064154/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 7055 T854 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355283064154/jetty4/index forceNew:false
[junit4:junit4]   2> 7058 T854 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355283064154/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1687436; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 7058 T854 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 7059 T854 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 7060 T854 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 7060 T854 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 7060 T854 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 7061 T854 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 7061 T854 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 7061 T854 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 7062 T854 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 7062 T854 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 7063 T854 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 7064 T854 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 7064 T854 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 7065 T854 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 7065 T854 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 7066 T854 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 7066 T854 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 7067 T854 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 7067 T854 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7068 T854 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7069 T854 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7069 T854 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7070 T854 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7071 T854 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7071 T854 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7072 T854 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 7073 T854 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 7075 T854 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 7077 T854 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 7078 T854 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 7080 T854 oass.SolrIndexSearcher.<init> Opening Searcher@db9e53 main
[junit4:junit4]   2> 7080 T854 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 7081 T854 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 7081 T854 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 7082 T854 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 7085 T854 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 7105 T855 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@db9e53 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 7110 T854 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 7111 T854 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 7230 T790 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7231 T790 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:42252_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:42252/solr"}
[junit4:junit4]   2> 7231 T790 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 7231 T790 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4]   2> 7233 T821 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7233 T836 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7233 T806 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7234 T789 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7234 T853 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7613 T854 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 7613 T854 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:42252/solr shardId:shard2
[junit4:junit4]   2> 7615 T854 oasc.ZkController.register We are http://127.0.0.1:42252/solr/collection1/ and leader is http://127.0.0.1:38213/solr/collection1/
[junit4:junit4]   2> 7616 T854 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:42252/solr
[junit4:junit4]   2> 7616 T854 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 7616 T854 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C27 name=collection1 org.apache.solr.core.SolrCore@13f5374 url=http://127.0.0.1:42252/solr/collection1 node=127.0.0.1:42252_solr
[junit4:junit4]   2> 7616 T856 C27 P42252 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 7617 T856 C27 P42252 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 7617 T854 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7617 T856 C27 P42252 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 7617 T856 C27 P42252 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 7618 T856 C27 P42252 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:38213/solr/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 7618 T856 C27 P42252 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:42252/solr START replicas=[http://127.0.0.1:38213/solr/collection1/] nUpdates=100
[junit4:junit4]   2> 7618 T767 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 7619 T856 C27 P42252 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 7619 T856 C27 P42252 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 7619 T767 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 7620 T856 C27 P42252 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 7620 T856 C27 P42252 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 7620 T767 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C28 name=collection1 org.apache.solr.core.SolrCore@1382f35 url=http://127.0.0.1:38213/solr/collection1 node=127.0.0.1:38213_solr
[junit4:junit4]   2> 7624 T817 C28 P38213 REQ /get {distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=1 
[junit4:junit4]   2> 7624 T767 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33453/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@36918b
[junit4:junit4]   2> 7625 T858 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33453. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 7625 T767 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 7626 T858 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33453, initiating session
[junit4:junit4]   2> 7626 T769 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:54210
[junit4:junit4]   2> 7626 T769 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:54210
[junit4:junit4]   2> 7627 T771 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8d2a655e000c with negotiated timeout 10000 for client /127.0.0.1:54210
[junit4:junit4]   2> 7627 T858 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33453, sessionid = 0x13b8d2a655e000c, negotiated timeout = 10000
[junit4:junit4]   2> 7627 T859 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@36918b name:ZooKeeperConnection Watcher:127.0.0.1:33453/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 7628 T767 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 7629 T767 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 7632 T767 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 7633 T767 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 7636 T767 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7637 T767 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):540
[junit4:junit4]   2> 7638 T767 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7737 T790 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7737 T790 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:42252_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:42252/solr"}
[junit4:junit4]   2> 7740 T789 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7740 T836 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7740 T859 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7740 T806 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7741 T821 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7740 T853 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8639 T767 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2>  C25_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:45437_solr, base_url=http://127.0.0.1:45437/solr}
[junit4:junit4]   2> 9451 T839 C25 P45437 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 9451 T839 C25 P45437 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 9451 T839 C25 P45437 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:57048/solr/collection1/. core=collection1
[junit4:junit4]   2> 9452 T839 C25 P45437 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 9456 T802 C26 P57048 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 9457 T802 C26 P57048 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355283064154/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@59f2ee; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 9458 T802 C26 P57048 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 9506 T802 C26 P57048 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355283064154/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@59f2ee; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355283064154/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@59f2ee; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 9506 T802 C26 P57048 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 9507 T802 C26 P57048 oass.SolrIndexSearcher.<init> Opening Searcher@1df914f realtime
[junit4:junit4]   2> 9507 T802 C26 P57048 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 9508 T802 C26 P57048 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 9508 T802 C26 P57048 /update {waitSearcher=true&openSearcher=false&commit=true&commit_end_point=true&wt=javabin&softCommit=false&version=2} {commit=} 0 53
[junit4:junit4]   2> 9522 T839 C25 P45437 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 9523 T839 C25 P45437 oascsi.HttpClientUtil.createClient Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
[junit4:junit4]   2> 9527 T839 C25 P45437 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 9530 T800 C26 P57048 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 9530 T800 C26 P57048 REQ /replication {command=indexversion&wt=javabin&qt=/replication&version=2} status=0 QTime=2 
[junit4:junit4]   2> 9531 T839 C25 P45437 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 9531 T839 C25 P45437 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 9531 T839 C25 P45437 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 9533 T801 C26 P57048 REQ /replication {command=filelist&generation=2&wt=javabin&qt=/replication&version=2} status=0 QTime=0 
[junit4:junit4]   2> 9534 T839 C25 P45437 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 9534 T839 C25 P45437 oash.SnapPuller.fetchLatestIndex Starting download to ./org.apache.solr.cloud.BasicDistributedZkTest-1355283064154/jetty3/index.20121212143113685 fullCopy=true
[junit4:junit4]   2> 9539 T802 C26 P57048 REQ /replication {file=segments_2&command=filecontent&checksum=true&generation=2&qt=/replication&wt=filestream} status=0 QTime=1 
[junit4:junit4]   2> 9542 T839 C25 P45437 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 9546 T839 C25 P45437 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20121212143113685
[junit4:junit4]   2> 9547 T839 C25 P45437 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.BasicDistributedZkTest-1355283064154/jetty3/index/ new=./org.apache.solr.cloud.BasicDistributedZkTest-1355283064154/jetty3/index.20121212143113685
[junit4:junit4]   2> 9547 T839 C25 P45437 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355283064154/jetty3/index.20121212143113685 forceNew:false
[junit4:junit4]   2> 9548 T839 C25 P45437 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355283064154/jetty3/index.20121212143113685 lockFactory=org.apache.lucene.store.NativeFSLockFactory@116eb6e; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 9549 T839 C25 P45437 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 9550 T839 C25 P45437 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 9550 T839 C25 P45437 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 9550 T839 C25 P45437 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4]   2> 9551 T839 C25 P45437 oasc.CachingDirectoryFactory.close Closing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355283064154/jetty3/index.20121212143113685
[junit4:junit4]   2> 9551 T839 C25 P45437 oash.SnapPuller$2.onClose removing old index directory ./org.apache.solr.cloud.BasicDistributedZkTest-1355283064154/jetty3/index
[junit4:junit4]   2> 9552 T839 C25 P45437 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355283064154/jetty3/index.20121212143113685 forceNew:true
[junit4:junit4]   2> 9553 T839 C25 P45437 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355283064154/jetty3/index.20121212143113685 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1517bb8; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 9553 T839 C25 P45437 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 9553 T839 C25 P45437 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 9554 T839 C25 P45437 oass.SolrIndexSearcher.<init> Opening Searcher@9e5ea6 main
[junit4:junit4]   2> 9554 T839 C25 P45437 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 9555 T838 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@9e5ea6 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 9556 T839 C25 P45437 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 9588 T839 C25 P45437 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355283064154/jetty3/index.20121212143113685 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1517bb8; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355283064154/jetty3/index.20121212143113685 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1517bb8; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 9589 T839 C25 P45437 oasc.SolrDeletionPolicy.updateCommits newest commit = 3
[junit4:junit4]   2> 9589 T839 C25 P45437 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 9589 T839 C25 P45437 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 9590 T839 C25 P45437 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 9590 T839 C25 P45437 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 9590 T839 C25 P45437 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 9591 T839 C25 P45437 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 9641 T767 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9748 T790 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9748 T790 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:45437_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:45437/solr"}
[junit4:junit4]   2> 9756 T789 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9756 T821 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9756 T836 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9756 T806 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9756 T859 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9756 T853 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2>  C27_STATE=coll:collection1 core:collection1 props:{shard=shard2, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:42252_solr, base_url=http://127.0.0.1:42252/solr}
[junit4:junit4]   2> 10625 T856 C27 P42252 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 10625 T856 C27 P42252 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 10625 T856 C27 P42252 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:38213/solr/collection1/. core=collection1
[junit4:junit4]   2> 10625 T856 C27 P42252 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 10630 T817 C28 P38213 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 10633 T817 C28 P38213 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355283064154/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1661095; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 10634 T817 C28 P38213 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 10642 T767 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10646 T817 C28 P38213 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355283064154/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1661095; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355283064154/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1661095; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 10646 T817 C28 P38213 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 10647 T817 C28 P38213 oass.SolrIndexSearcher.<init> Opening Searcher@134011c realtime
[junit4:junit4]   2> 10647 T817 C28 P38213 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 10647 T817 C28 P38213 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 10648 T817 C28 P38213 /update {waitSearcher=true&openSearcher=false&commit=true&commit_end_point=true&wt=javabin&softCommit=false&version=2} {commit=} 0 18
[junit4:junit4]   2> 10649 T856 C27 P42252 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 10649 T856 C27 P42252 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 10651 T815 C28 P38213 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 10651 T815 C28 P38213 REQ /replication {command=indexversion&wt=javabin&qt=/replication&version=2} status=0 QTime=1 
[junit4:junit4]   2> 10651 T856 C27 P42252 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 10652 T856 C27 P42252 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 10652 T856 C27 P42252 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 10654 T817 C28 P38213 REQ /replication {command=filelist&generation=2&wt=javabin&qt=/replication&version=2} status=0 QTime=1 
[junit4:junit4]   2> 10654 T856 C27 P42252 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 10654 T856 C27 P42252 oash.SnapPuller.fetchLatestIndex Starting download to ./org.apache.solr.cloud.BasicDistributedZkTest-1355283064154/jetty4/index.20121212143114805 fullCopy=true
[junit4:junit4]   2> 10657 T816 C28 P38213 REQ /replication {file=segments_2&command=filecontent&checksum=true&generation=2&qt=/replication&wt=filestream} status=0 QTime=1 
[junit4:junit4]   2> 10658 T856 C27 P42252 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 10666 T856 C27 P42252 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20121212143114805
[junit4:junit4]   2> 10666 T856 C27 P42252 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.BasicDistributedZkTest-1355283064154/jetty4/index/ new=./org.apache.solr.cloud.BasicDistributedZkTest-1355283064154/jetty4/index.20121212143114805
[junit4:junit4]   2> 10667 T856 C27 P42252 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355283064154/jetty4/index.20121212143114805 forceNew:false
[junit4:junit4]   2> 10668 T856 C27 P42252 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355283064154/jetty4/index.20121212143114805 lockFactory=org.apache.lucene.store.NativeFSLockFactory@894931; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 10668 T856 C27 P42252 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 10669 T856 C27 P42252 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 10669 T856 C27 P42252 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 10669 T856 C27 P42252 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4]   2> 10669 T856 C27 P42252 oasc.CachingDirectoryFactory.close Closing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355283064154/jetty4/index.20121212143114805
[junit4:junit4]   2> 10670 T856 C27 P42252 oash.SnapPuller$2.onClose removing old index directory ./org.apache.solr.cloud.BasicDistributedZkTest-1355283064154/jetty4/index
[junit4:junit4]   2> 10670 T856 C27 P42252 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355283064154/jetty4/index.20121212143114805 forceNew:true
[junit4:junit4]   2> 10671 T856 C27 P42252 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355283064154/jetty4/index.20121212143114805 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1f6718f; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 10672 T856 C27 P42252 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 10672 T856 C27 P42252 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 10672 T856 C27 P42252 oass.SolrIndexSearcher.<init> Opening Searcher@cabda9 main
[junit4:junit4]   2> 10672 T856 C27 P42252 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 10674 T855 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@cabda9 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 10674 T856 C27 P42252 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 10707 T856 C27 P42252 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355283064154/jetty4/index.20121212143114805 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1f6718f; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355283064154/jetty4/index.20121212143114805 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1f6718f; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 10708 T856 C27 P42252 oasc.SolrDeletionPolicy.updateCommits newest commit = 3
[junit4:junit4]   2> 10708 T856 C27 P42252 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 10708 T856 C27 P42252 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 10709 T856 C27 P42252 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 10709 T856 C27 P42252 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 10709 T856 C27 P42252 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 10710 T856 C27 P42252 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 10761 T790 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10762 T790 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:42252_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:42252/solr"}
[junit4:junit4]   2> 10765 T836 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10765 T853 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10765 T859 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10765 T821 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10765 T806 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10765 T789 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 11644 T767 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> ASYNC  NEW_CORE C29 name=collection1 org.apache.solr.core.SolrCore@b22fa4 url=http://127.0.0.1:41150/solr/collection1 node=127.0.0.1:41150_solr
[junit4:junit4]   2> 11652 T782 C29 P41150 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355283064154/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@16e6221; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 11652 T782 C29 P41150 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 11653 T782 C29 P41150 oass.SolrIndexSearcher.<init> Opening Searcher@12ca788 realtime
[junit4:junit4]   2> 11654 T782 C29 P41150 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 11654 T782 C29 P41150 /update {wt=javabin&version=2} {deleteByQuery=*:* (-1421117306491109376)} 0 5
[junit4:junit4]   2> 11655 T767 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33453/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@ab0ed8
[junit4:junit4]   2> 11656 T862 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33453. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 11656 T767 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 11656 T862 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33453, initiating session
[junit4:junit4]   2> 11656 T769 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:54218
[junit4:junit4]   2> 11657 T769 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:54218
[junit4:junit4]   2> 11657 T771 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8d2a655e000d with negotiated timeout 10000 for client /127.0.0.1:54218
[junit4:junit4]   2> 11657 T862 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33453, sessionid = 0x13b8d2a655e000d, negotiated timeout = 10000
[junit4:junit4]   2> 11658 T863 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ab0ed8 name:ZooKeeperConnection Watcher:127.0.0.1:33453/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 11658 T767 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 11659 T767 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2>  C25_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:45437_solr, base_url=http://127.0.0.1:45437/solr}
[junit4:junit4]   2> 11669 T830 C25 P45437 REQ /update {update.distrib=FROMLEADER&_version_=-1421117306505789440&update.from=http://127.0.0.1:57048/solr/collection1/&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2>  C27_STATE=coll:collection1 core:collection1 props:{shard=shard2, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:42252_solr, base_url=http://127.0.0.1:42252/solr}
[junit4:junit4]   2> 11670 T848 C27 P42252 REQ /update {update.distrib=FROMLEADER&_version_=-1421117306503692288&update.from=http://127.0.0.1:38213/solr/collection1/&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11670 T802 C26 P57048 REQ /update {update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=6 
[junit4:junit4]   2> 11671 T816 C28 P38213 /update {wt=javabin&version=2} {deleteByQuery=*:* (-1421117306503692288)} 0 9
[junit4:junit4]   2> 11676 T784 C29 P41150 /update {wt=javabin&version=2} {add=[1 (1421117306516275200)]} 0 3
[junit4:junit4]   2> 11683 T831 C25 P45437 REQ /update {distrib.from=http://127.0.0.1:57048/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 11684 T799 C26 P57048 /update {wt=javabin&version=2} {add=[1 (1421117306520469504)]} 0 7
[junit4:junit4]   2> 11688 T783 C29 P41150 /update {wt=javabin&version=2} {add=[2 (1421117306528858112)]} 0 2
[junit4:junit4]   2> 11699 T849 C27 P42252 REQ /update {distrib.from=http://127.0.0.1:38213/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 11700 T815 C28 P38213 REQ /update {distrib.from=http://127.0.0.1:57048/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=7 
[junit4:junit4]   2> 11701 T800 C26 P57048 /update {wt=javabin&version=2} {add=[2]} 0 11
[junit4:junit4]   2> 11704 T785 C29 P41150 /update {wt=javabin&version=2} {add=[3 (1421117306546683904)]} 0 1
[junit4:junit4]   2> 11711 T846 C27 P42252 REQ /update {distrib.from=http://127.0.0.1:38213/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11712 T817 C28 P38213 /update {wt=javabin&version=2} {add=[3 (1421117306550878208)]} 0 5
[junit4:junit4]   2> 11715 T782 C29 P41150 /update {wt=javabin&version=2} {add=[4 (1421117306558218240)]} 0 1
[junit4:junit4]   2> 11722 T829 C25 P45437 REQ /update {distrib.from=http://127.0.0.1:57048/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11722 T801 C26 P57048 /update {wt=javabin&version=2} {add=[4 (1421117306562412544)]} 0 5
[junit4:junit4]   2> 11725 T784 C29 P41150 /update {wt=javabin&version=2} {add=[5 (1421117306569752576)]} 0 0
[junit4:junit4]   2> 11733 T848 C27 P42252 REQ /update {distrib.from=http://127.0.0.1:38213/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 11733 T816 C28 P38213 /update {wt=javabin&version=2} {add=[5 (1421117306572898304)]} 0 5
[junit4:junit4]   2> 11737 T783 C29 P41150 /update {wt=javabin&version=2} {add=[6 (1421117306581286912)]} 0 1
[junit4:junit4]   2> 11742 T849 C27 P42252 REQ /update {distrib.from=http://127.0.0.1:38213/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 11743 T814 C28 P38213 /update {wt=javabin&version=2} {add=[6 (1421117306584432640)]} 0 4
[junit4:junit4]   2> 11746 T785 C29 P41150 /update {wt=javabin&version=2} {add=[7 (1421117306590724096)]} 0 1
[junit4:junit4]   2> 11754 T847 C27 P42252 REQ /update {distrib.from=http://127.0.0.1:38213/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 11755 T815 C28 P38213 REQ /update {distrib.from=http://127.0.0.1:57048/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=5 
[junit4:junit4]   2> 11755 T802 C26 P57048 /update {wt=javabin&version=2} {add=[7]} 0 7
[junit4:junit4]   2> 11758 T784 C29 P41150 /update {wt=javabin&version=2} {add=[8 (1421117306603307008)]} 0 1
[junit4:junit4]   2> 11767 T831 C25 P45437 REQ /update {distrib.from=http://127.0.0.1:57048/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11768 T799 C26 P57048 /update {wt=javabin&version=2} {add=[8 (1421117306607501312)]} 0 8
[junit4:junit4]   2> 11771 T785 C29 P41150 /update {wt=javabin&version=2} {add=[9 (1421117306616938496)]} 0 1
[junit4:junit4]   2> 11778 T846 C27 P42252 REQ /update {distrib.from=http://127.0.0.1:38213/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 11779 T817 C28 P38213 REQ /update {distrib.from=http://127.0.0.1:57048/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=4 
[junit4:junit4]   2> 11780 T800 C26 P57048 /update {wt=javabin&version=2} {add=[9]} 0 7
[junit4:junit4]   2> 11785 T782 C29 P41150 /update {wt=javabin&version=2} {add=[10 (1421117306629521408)]} 0 3
[junit4:junit4]   2> 11791 T832 C25 P45437 REQ /update {distrib.from=http://127.0.0.1:57048/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11792 T801 C26 P57048 /update {wt=javabin&version=2} {add=[10 (1421117306634764288)]} 0 5
[junit4:junit4]   2> 11796 T783 C29 P41150 /update {wt=javabin&version=2} {add=[11 (1421117306642104320)]} 0 2
[junit4:junit4]   2> 11802 T830 C25 P45437 REQ /update {distrib.from=http://127.0.0.1:57048/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11803 T802 C26 P57048 /update {wt=javabin&version=2} {add=[11 (1421117306647347200)]} 0 5
[junit4:junit4]   2> 11806 T784 C29 P41150 /update {wt=javabin&version=2} {add=[12 (1421117306653638656)]} 0 1
[junit4:junit4]   2> 11812 T829 C25 P45437 REQ /update {distrib.from=http://127.0.0.1:57048/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11813 T799 C26 P57048 /update {wt=javabin&version=2} {add=[12 (1421117306656784384)]} 0 5
[junit4:junit4]   2> 11816 T785 C29 P41150 /update {wt=javabin&version=2} {add=[13 (1421117306664124416)]} 0 1
[junit4:junit4]   2> 11822 T831 C25 P45437 REQ /update {distrib.from=http://127.0.0.1:57048/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 11823 T800 C26 P57048 /update {wt=javabin&version=2} {add=[13 (1421117306667270144)]} 0 5
[junit4:junit4]   2> 11826 T782 C29 P41150 /update {wt=javabin&version=2} {add=[14 (1421117306675658752)]} 0 0
[junit4:junit4]   2> 11833 T832 C25 P45437 REQ /update {distrib.from=http://127.0.0.1:57048/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11833 T801 C26 P57048 /update {wt=javabin&version=2} {add=[14 (1421117306678804480)]} 0 5
[junit4:junit4]   2> 11836 T783 C29 P41150 /update {wt=javabin&version=2} {add=[15 (1421117306686144512)]} 0 0
[junit4:junit4]   2> 11844 T830 C25 P45437 REQ /update {distrib.from=http://127.0.0.1:57048/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11845 T802 C26 P57048 REQ /update {distrib.from=http://127.0.0.1:38213/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=5 
[junit4:junit4]   2> 11845 T816 C28 P38213 /update {wt=javabin&version=2} {add=[15]} 0 6
[junit4:junit4]   2> 11848 T784 C29 P41150 /update {wt=javabin&version=2} {add=[16 (1421117306697678848)]} 0 1
[junit4:junit4]   2> 11858 T829 C25 P45437 REQ /update {distrib.from=http://127.0.0.1:57048/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=3 
[junit4:junit4]   2> 11858 T799 C26 P57048 /update {wt=javabin&version=2} {add=[16 (1421117306700824576)]} 0 8
[junit4:junit4]   2> 11863 T785 C29 P41150 /update {wt=javabin&version=2} {add=[17 (1421117306712358912)]} 0 2
[junit4:junit4]   2> 11874 T848 C27 P42252 REQ /update {distrib.from=http://127.0.0.1:38213/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 11875 T814 C28 P38213 REQ /update {distrib.from=http://127.0.0.1:57048/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=8 
[junit4:junit4]   2> 11876 T800 C26 P57048 /update {wt=javabin&version=2} {add=[17]} 0 11
[junit4:junit4]   2> 11879 T782 C29 P41150 /update {wt=javabin&version=2} {add=[100 (1421117306730184704)]} 0 1
[junit4:junit4]   2> 11888 T831 C25 P45437 REQ /update {distrib.from=http://127.0.0.1:57048/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11888 T801 C26 P57048 REQ /update {distrib.from=http://127.0.0.1:38213/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=5 
[junit4:junit4]   2> 11889 T815 C28 P38213 /update {wt=javabin&version=2} {add=[100]} 0 8
[junit4:junit4]   2> 11892 T783 C29 P41150 /update {wt=javabin&version=2} {add=[101 (1421117306744864768)]} 0 1
[junit4:junit4]   2> 11900 T832 C25 P45437 REQ /update {distrib.from=http://127.0.0.1:57048/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11901 T802 C26 P57048 REQ /update {distrib.from=http://127.0.0.1:38213/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=5 
[junit4:junit4]   2> 11901 T817 C28 P38213 /update {wt=javabin&version=2} {add=[101]} 0 7
[junit4:junit4]   2> 11907 T784 C29 P41150 /update {wt=javabin&version=2} {add=[102 (1421117306756399104)]} 0 4
[junit4:junit4]   2> 11914 T830 C25 P45437 REQ /update {distrib.from=http://127.0.0.1:57048/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 11915 T799 C26 P57048 REQ /update {distrib.from=http://127.0.0.1:38213/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=4 
[junit4:junit4]   2> 11916 T816 C28 P38213 /update {wt=javabin&version=2} {add=[102]} 0 7
[junit4:junit4]   2> 11919 T785 C29 P41150 /update {wt=javabin&version=2} {add=[103 (1421117306772127744)]} 0 1
[junit4:junit4]   2> 11927 T849 C27 P42252 REQ /update {distrib.from=http://127.0.0.1:38213/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11928 T814 C28 P38213 REQ /update {distrib.from=http://127.0.0.1:57048/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=4 
[junit4:junit4]   2> 11928 T801 C26 P57048 /update {wt=javabin&version=2} {add=[103]} 0 6
[junit4:junit4]   2> 11932 T782 C29 P41150 /update {wt=javabin&version=2} {add=[104 (1421117306785759232)]} 0 1
[junit4:junit4]   2> 11940 T847 C27 P42252 REQ /update {distrib.from=http://127.0.0.1:38213/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 11940 T815 C28 P38213 REQ /update {distrib.from=http://127.0.0.1:57048/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=4 
[junit4:junit4]   2> 11941 T802 C26 P57048 /update {wt=javabin&version=2} {add=[104]} 0 7
[junit4:junit4]   2> 11944 T783 C29 P41150 /update {wt=javabin&version=2} {add=[105 (1421117306799390720)]} 0 1
[junit4:junit4]   2> 11956 T846 C27 P42252 REQ /update {distrib.from=http://127.0.0.1:38213/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=4 
[junit4:junit4]   2> 11956 T817 C28 P38213 /update {wt=javabin&version=2} {add=[105 (1421117306802536448)]} 0 10
[junit4:junit4]   2> 11959 T784 C29 P41150 /update {wt=javabin&version=2} {add=[106 (1421117306814070784)]} 0 1
[junit4:junit4]   2> 11966 T848 C27 P42252 REQ /update {distrib.from=http://127.0.0.1:38213/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 11967 T816 C28 P38213 /update {wt=javabin&version=2} {add=[106 (1421117306817216512)]} 0 6
[junit4:junit4]   2> 11970 T785 C29 P41150 /update {wt=javabin&version=2} {add=[107 (1421117306825605120)]} 0 1
[junit4:junit4]   2> 11977 T829 C25 P45437 REQ /update {distrib.from=http://127.0.0.1:57048/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 11978 T799 C26 P57048 REQ /update {distrib.from=http://127.0.0.1:38213/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=4 
[junit4:junit4]   2> 11979 T814 C28 P38213 /update {wt=javabin&version=2} {add=[107]} 0 7
[junit4:junit4]   2> 11981 T782 C29 P41150 /update {wt=javabin&version=2} {add=[108 (1421117306838188032)]} 0 0
[junit4:junit4]   2> 11986 T831 C25 P45437 REQ 

[...truncated too long message...]

      "node_name":"127.0.0.1:47261_solr",
[junit4:junit4]   1>                 "base_url":"http://127.0.0.1:47261/solr",
[junit4:junit4]   1>                 "leader":"true"}}}}}
[junit4:junit4]   1>  /zookeeper (1)
[junit4:junit4]   1>  DATA:
[junit4:junit4]   1>      
[junit4:junit4]   1> 
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=SyncSliceTest -Dtests.method=testDistribSearch -Dtests.seed=8C2C5FE1A5F7421E -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=iw_IL -Dtests.timezone=America/Araguaina -Dtests.file.encoding=UTF-8
[junit4:junit4] FAILURE  584s J1 | SyncSliceTest.testDistribSearch <<<
[junit4:junit4]    > Throwable #1: java.lang.AssertionError: There are still nodes recoverying - waited for 540 seconds
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([8C2C5FE1A5F7421E:DCAD1F9D2A82222]:0)
[junit4:junit4]    > 	at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:165)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:115)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:110)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:563)
[junit4:junit4]    > 	at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:224)
[junit4:junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:601)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 583633 T1374 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> NOTE: test params are: codec=Lucene41: {range_facet_l=PostingsFormat(name=MockRandom), text=Lucene41(blocksize=128), _version_=PostingsFormat(name=MockRandom), rnd_b=PostingsFormat(name=Memory doPackFST= false), intDefault=PostingsFormat(name=MockRandom), timestamp=PostingsFormat(name=MockRandom), id=PostingsFormat(name=Memory doPackFST= false), a_t=PostingsFormat(name=MockRandom), range_facet_sl=Lucene41(blocksize=128), range_facet_si=Pulsing41(freqCutoff=7 minBlockSize=100 maxBlockSize=215), other_tl1=PostingsFormat(name=MockRandom), multiDefault=Pulsing41(freqCutoff=7 minBlockSize=100 maxBlockSize=215), a_si=Pulsing41(freqCutoff=7 minBlockSize=100 maxBlockSize=215)}, sim=RandomSimilarityProvider(queryNorm=true,coord=no): {}, locale=iw_IL, timezone=America/Araguaina
[junit4:junit4]   2> NOTE: Linux 3.2.0-34-generic i386/Oracle Corporation 1.7.0_09 (32-bit)/cpus=8,threads=1,free=164520840,total=256311296
[junit4:junit4]   2> NOTE: All tests run in this JVM: [LukeRequestHandlerTest, PrimitiveFieldTypeTest, TestHashPartitioner, IndexSchemaTest, XmlUpdateRequestHandlerTest, ZkSolrClientTest, TestSolrDeletionPolicy2, TestDistributedGrouping, TestZkChroot, IndexReaderFactoryTest, TestOmitPositions, SuggesterTest, TestCollationKeyRangeQueries, BadIndexSchemaTest, ReturnFieldsTest, DirectSolrSpellCheckerTest, FieldMutatingUpdateProcessorTest, DocumentAnalysisRequestHandlerTest, ClusterStateUpdateTest, XsltUpdateRequestHandlerTest, QueryEqualityTest, FileUtilsTest, TestRemoteStreaming, TestStressRecovery, URLClassifyProcessorTest, BasicFunctionalityTest, TestRTGBase, TestBM25SimilarityFactory, TestMultiCoreConfBootstrap, TestDistributedSearch, OverseerTest, TestUpdate, TestSolrCoreProperties, TestSolrJ, TestQueryUtils, SchemaVersionSpecificBehaviorTest, CoreContainerCoreInitFailuresTest, QueryParsingTest, TestCSVLoader, BasicDistributedZk2Test, StatsComponentTest, StandardRequestHandlerTest, EchoParamsTest, SuggesterTSTTest, TimeZoneUtilsTest, OpenExchangeRatesOrgProviderTest, TestFuzzyAnalyzedSuggestions, ClusterStateTest, TestPluginEnable, RAMDirectoryFactoryTest, IndexSchemaRuntimeFieldTest, TestSort, PingRequestHandlerTest, TestBinaryField, SpellingQueryConverterTest, OutputWriterTest, TestQuerySenderListener, TestPhraseSuggestions, SyncSliceTest]
[junit4:junit4] Completed on J1 in 583.66s, 1 test, 1 failure <<< FAILURES!

[...truncated 12 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:352: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:178: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:438: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1171: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:835: There were test failures: 239 suites, 994 tests, 1 error, 2 failures, 7 ignored (2 assumptions)

Total time: 42 minutes 58 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 32bit/jdk1.7.0_09 -client -XX:+UseParallelGC
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-4.x-Linux (32bit/jdk1.6.0_37) - Build # 3174 - Still Failing!

Posted by Policeman Jenkins Server <je...@sd-datasolutions.de>.
Build: http://jenkins.sd-datasolutions.de/job/Lucene-Solr-4.x-Linux/3174/
Java: 32bit/jdk1.6.0_37 -client -XX:+UseSerialGC

3 tests failed.
REGRESSION:  org.apache.solr.cloud.SyncSliceTest.testDistribSearch

Error Message:
There are still nodes recoverying - waited for 540 seconds

Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 540 seconds
	at __randomizedtesting.SeedInfo.seed([30468AF19F50A0B1:B1A004E9E80FC08D]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:165)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:115)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:110)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:563)
	at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:224)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:662)


FAILED:  org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch

Error Message:
There are still nodes recoverying - waited for 540 seconds

Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 540 seconds
	at __randomizedtesting.SeedInfo.seed([30468AF19F50A0B1:B1A004E9E80FC08D]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:165)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:115)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:110)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:563)
	at org.apache.solr.cloud.BasicDistributedZk2Test.brindDownShardIndexSomeDocsAndRecover(BasicDistributedZk2Test.java:321)
	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:83)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:662)


FAILED:  org.apache.solr.cloud.BasicDistributedZkTest.testDistribSearch

Error Message:
Server at http://127.0.0.1:33040/solr returned non ok status:500, message:Server Error

Stack Trace:
org.apache.solr.common.SolrException: Server at http://127.0.0.1:33040/solr returned non ok status:500, message:Server Error
	at __randomizedtesting.SeedInfo.seed([30468AF19F50A0B1:B1A004E9E80FC08D]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:372)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
	at org.apache.solr.client.solrj.request.CoreAdminRequest.process(CoreAdminRequest.java:429)
	at org.apache.solr.client.solrj.request.CoreAdminRequest.getStatus(CoreAdminRequest.java:472)
	at org.apache.solr.cloud.BasicDistributedZkTest.collectStartTimes(BasicDistributedZkTest.java:959)
	at org.apache.solr.cloud.BasicDistributedZkTest.testCollectionsAPI(BasicDistributedZkTest.java:795)
	at org.apache.solr.cloud.BasicDistributedZkTest.doTest(BasicDistributedZkTest.java:343)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:662)




Build Log:
[...truncated 8179 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZkTest
[junit4:junit4]   2> 3 T949 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZkTest-1355278903655
[junit4:junit4]   2> 4 T949 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 5 T950 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 5 T950 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 6 T950 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4]   2> 6 T950 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4]   2> 6 T950 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 7 T950 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355278903655/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4]   2> 105 T949 oasc.ZkTestServer.run start zk server on port:60112
[junit4:junit4]   2> 105 T949 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60112 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@dd52d8
[junit4:junit4]   2> 107 T955 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:60112. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 106 T949 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 107 T955 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:60112, initiating session
[junit4:junit4]   2> 107 T951 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:41127
[junit4:junit4]   2> 107 T951 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:41127
[junit4:junit4]   2> 108 T953 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 167 T953 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8ceae96a0000 with negotiated timeout 10000 for client /127.0.0.1:41127
[junit4:junit4]   2> 167 T955 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:60112, sessionid = 0x13b8ceae96a0000, negotiated timeout = 10000
[junit4:junit4]   2> 167 T956 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@dd52d8 name:ZooKeeperConnection Watcher:127.0.0.1:60112 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 168 T949 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 168 T949 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 171 T954 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8ceae96a0000
[junit4:junit4]   2> 172 T956 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 172 T951 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:41127 which had sessionid 0x13b8ceae96a0000
[junit4:junit4]   2> 172 T949 oaz.ZooKeeper.close Session: 0x13b8ceae96a0000 closed
[junit4:junit4]   2> 173 T949 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60112/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@ccb535
[junit4:junit4]   2> 174 T957 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:60112. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 173 T949 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 174 T957 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:60112, initiating session
[junit4:junit4]   2> 174 T951 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:41128
[junit4:junit4]   2> 174 T951 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:41128
[junit4:junit4]   2> 175 T953 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8ceae96a0001 with negotiated timeout 10000 for client /127.0.0.1:41128
[junit4:junit4]   2> 175 T957 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:60112, sessionid = 0x13b8ceae96a0001, negotiated timeout = 10000
[junit4:junit4]   2> 175 T958 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ccb535 name:ZooKeeperConnection Watcher:127.0.0.1:60112/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 175 T949 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 176 T949 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 178 T949 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 180 T949 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 181 T949 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 183 T949 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 183 T949 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 186 T949 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 187 T949 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 189 T949 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 190 T949 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 192 T949 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 193 T949 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 195 T949 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 195 T949 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 197 T949 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 197 T949 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 199 T949 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 200 T949 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 201 T949 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 202 T949 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 204 T949 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 205 T949 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 207 T949 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 207 T949 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 209 T954 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8ceae96a0001
[junit4:junit4]   2> 209 T951 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:41128 which had sessionid 0x13b8ceae96a0001
[junit4:junit4]   2> 209 T949 oaz.ZooKeeper.close Session: 0x13b8ceae96a0001 closed
[junit4:junit4]   2> 210 T958 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 264 T949 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 268 T949 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:39255
[junit4:junit4]   2> 268 T949 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 269 T949 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355278903861
[junit4:junit4]   2> 269 T949 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355278903861/'
[junit4:junit4]   2> 297 T949 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 298 T949 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 298 T949 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355278903861
[junit4:junit4]   2> 299 T949 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355278903861/solr.xml
[junit4:junit4]   2> 299 T949 oasc.CoreContainer.<init> New CoreContainer 13486311
[junit4:junit4]   2> 300 T949 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355278903861/'
[junit4:junit4]   2> 300 T949 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355278903861/'
[junit4:junit4]   2> 314 T949 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 325 T949 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:60112/solr
[junit4:junit4]   2> 326 T949 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 327 T949 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60112 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@18e4f01
[junit4:junit4]   2> 328 T968 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:60112. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 327 T949 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 328 T968 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:60112, initiating session
[junit4:junit4]   2> 328 T951 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:41129
[junit4:junit4]   2> 328 T951 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:41129
[junit4:junit4]   2> 330 T953 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8ceae96a0002 with negotiated timeout 20000 for client /127.0.0.1:41129
[junit4:junit4]   2> 330 T968 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:60112, sessionid = 0x13b8ceae96a0002, negotiated timeout = 20000
[junit4:junit4]   2> 330 T969 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@18e4f01 name:ZooKeeperConnection Watcher:127.0.0.1:60112 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 330 T949 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 332 T954 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8ceae96a0002
[junit4:junit4]   2> 332 T969 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 332 T951 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:41129 which had sessionid 0x13b8ceae96a0002
[junit4:junit4]   2> 332 T949 oaz.ZooKeeper.close Session: 0x13b8ceae96a0002 closed
[junit4:junit4]   2> 333 T949 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60112/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@16d389f
[junit4:junit4]   2> 334 T970 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:60112. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 334 T949 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 335 T951 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:41130
[junit4:junit4]   2> 335 T970 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:60112, initiating session
[junit4:junit4]   2> 335 T951 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:41130
[junit4:junit4]   2> 336 T953 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8ceae96a0003 with negotiated timeout 8000 for client /127.0.0.1:41130
[junit4:junit4]   2> 336 T970 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:60112, sessionid = 0x13b8ceae96a0003, negotiated timeout = 8000
[junit4:junit4]   2> 336 T971 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@16d389f name:ZooKeeperConnection Watcher:127.0.0.1:60112/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 337 T949 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 338 T954 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ceae96a0003 type:create cxid:0x2 zxid:0x1b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 339 T949 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 340 T949 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39255_solr
[junit4:junit4]   2> 341 T954 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ceae96a0003 type:delete cxid:0x7 zxid:0x1d txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:39255_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:39255_solr
[junit4:junit4]   2> 341 T949 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:39255_solr
[junit4:junit4]   2> 343 T949 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 344 T949 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 345 T949 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 345 T949 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 346 T949 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 347 T949 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 347 T949 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 348 T949 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 349 T949 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 349 T949 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 353 T949 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 357 T954 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ceae96a0003 type:delete cxid:0x15 zxid:0x22 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 357 T949 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 359 T949 oasc.Overseer.start Overseer (id=88819558230130691-127.0.0.1:39255_solr-n_0000000000) starting
[junit4:junit4]   2> 359 T954 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ceae96a0003 type:create cxid:0x1a zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 360 T954 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ceae96a0003 type:create cxid:0x1b zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 360 T954 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ceae96a0003 type:create cxid:0x1c zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 361 T954 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ceae96a0003 type:create cxid:0x1d zxid:0x27 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 362 T973 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
[junit4:junit4]   2> 362 T949 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 364 T949 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 365 T972 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 369 T974 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355278903861/collection1
[junit4:junit4]   2> 370 T974 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4]   2> 370 T974 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 370 T974 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4]   2> 371 T974 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355278903861/collection1/'
[junit4:junit4]   2> 372 T974 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355278903861/collection1/lib/README' to classloader
[junit4:junit4]   2> 372 T974 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355278903861/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 412 T974 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 462 T974 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 463 T974 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 467 T974 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 938 T974 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 945 T974 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 948 T974 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 957 T974 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 975 T974 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 978 T974 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 979 T974 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 980 T974 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355278903861/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355278903655/control/data/
[junit4:junit4]   2> 980 T974 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@8c436b
[junit4:junit4]   2> 981 T974 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355278903655/control/data/index/
[junit4:junit4]   2> 981 T974 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355278903655/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 982 T974 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355278903655/control/data/index forceNew:false
[junit4:junit4]   2> 985 T974 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355278903655/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1b8d279),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 985 T974 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 985 T974 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 987 T974 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 987 T974 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 987 T974 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 987 T974 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 988 T974 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 988 T974 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 988 T974 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 989 T974 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 990 T974 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 990 T974 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 991 T974 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 991 T974 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 992 T974 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 992 T974 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 992 T974 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 993 T974 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 994 T974 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 994 T974 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 995 T974 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 996 T974 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 996 T974 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 997 T974 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 997 T974 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 998 T974 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 999 T974 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 1001 T974 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 1002 T974 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 1003 T974 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 1005 T974 oass.SolrIndexSearcher.<init> Opening Searcher@4498 main
[junit4:junit4]   2> 1006 T974 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 1006 T974 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 1006 T974 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 1007 T974 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 1012 T974 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 1033 T975 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4498 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 1037 T974 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 1037 T974 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 1038 T954 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ceae96a0003 type:create cxid:0x53 zxid:0x2a txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 1039 T974 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 1040 T974 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:39255/solr shardId:control_shard
[junit4:junit4]   2> 1040 T974 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/control_shard/election
[junit4:junit4]   2> 1044 T954 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ceae96a0003 type:delete cxid:0x62 zxid:0x31 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4]   2> 1045 T974 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 1045 T954 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ceae96a0003 type:create cxid:0x63 zxid:0x32 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1369 T972 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 1370 T972 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":"control_shard",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:39255_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:39255/solr"}
[junit4:junit4]   2> 1370 T954 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ceae96a0003 type:create cxid:0x6a zxid:0x34 txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 1375 T971 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 1546 T974 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 1547 T974 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 1547 T974 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:39255/solr/collection1/
[junit4:junit4]   2> 1547 T974 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 1548 T974 oasc.SyncStrategy.syncToMe http://127.0.0.1:39255/solr/collection1/ has no replicas
[junit4:junit4]   2> 1548 T974 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:39255/solr/collection1/
[junit4:junit4]   2> 1548 T974 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/control_shard
[junit4:junit4]   2> 1551 T954 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ceae96a0003 type:create cxid:0x89 zxid:0x3f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1879 T972 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 1881 T971 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 1903 T974 oasc.ZkController.register We are http://127.0.0.1:39255/solr/collection1/ and leader is http://127.0.0.1:39255/solr/collection1/
[junit4:junit4]   2> 1903 T974 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:39255/solr
[junit4:junit4]   2> 1903 T974 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 1903 T974 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 1904 T974 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 1905 T974 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 1908 T949 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 1908 T949 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 1909 T949 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 1966 T949 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 1969 T949 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:40546
[junit4:junit4]   2> 1970 T949 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 1971 T949 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355278905563
[junit4:junit4]   2> 1972 T949 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355278905563/'
[junit4:junit4]   2> 1984 T949 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 1985 T949 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 1985 T949 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355278905563
[junit4:junit4]   2> 1986 T949 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355278905563/solr.xml
[junit4:junit4]   2> 1986 T949 oasc.CoreContainer.<init> New CoreContainer 24674224
[junit4:junit4]   2> 1987 T949 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355278905563/'
[junit4:junit4]   2> 1987 T949 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355278905563/'
[junit4:junit4]   2> 2000 T949 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 2011 T949 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:60112/solr
[junit4:junit4]   2> 2012 T949 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 2012 T949 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60112 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@15e112d
[junit4:junit4]   2> 2014 T985 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:60112. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 2013 T949 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2014 T951 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:41132
[junit4:junit4]   2> 2014 T985 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:60112, initiating session
[junit4:junit4]   2> 2015 T951 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:41132
[junit4:junit4]   2> 2015 T953 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8ceae96a0004 with negotiated timeout 20000 for client /127.0.0.1:41132
[junit4:junit4]   2> 2015 T985 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:60112, sessionid = 0x13b8ceae96a0004, negotiated timeout = 20000
[junit4:junit4]   2> 2016 T986 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@15e112d name:ZooKeeperConnection Watcher:127.0.0.1:60112 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2016 T949 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2017 T954 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8ceae96a0004
[junit4:junit4]   2> 2017 T986 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 2017 T951 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:41132 which had sessionid 0x13b8ceae96a0004
[junit4:junit4]   2> 2017 T949 oaz.ZooKeeper.close Session: 0x13b8ceae96a0004 closed
[junit4:junit4]   2> 2018 T949 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60112/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@18778c6
[junit4:junit4]   2> 2020 T987 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:60112. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 2019 T949 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2020 T987 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:60112, initiating session
[junit4:junit4]   2> 2020 T951 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:41133
[junit4:junit4]   2> 2020 T951 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:41133
[junit4:junit4]   2> 2021 T953 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8ceae96a0005 with negotiated timeout 8000 for client /127.0.0.1:41133
[junit4:junit4]   2> 2021 T987 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:60112, sessionid = 0x13b8ceae96a0005, negotiated timeout = 8000
[junit4:junit4]   2> 2021 T988 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@18778c6 name:ZooKeeperConnection Watcher:127.0.0.1:60112/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2021 T949 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2022 T954 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ceae96a0005 type:create cxid:0x1 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2023 T954 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ceae96a0005 type:create cxid:0x2 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2023 T949 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40546_solr
[junit4:junit4]   2> 2024 T954 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ceae96a0005 type:delete cxid:0x4 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:40546_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:40546_solr
[junit4:junit4]   2> 2024 T949 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:40546_solr
[junit4:junit4]   2> 2026 T971 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 2027 T971 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 2027 T949 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 2027 T949 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 2028 T949 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 2028 T949 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 2029 T949 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 2029 T949 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 2030 T949 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 2030 T949 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 2030 T949 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 2031 T949 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 2036 T949 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 2041 T989 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355278905563/collection1
[junit4:junit4]   2> 2042 T989 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 2042 T989 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 2042 T989 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 2043 T989 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355278905563/collection1/'
[junit4:junit4]   2> 2043 T989 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty1-1355278905563/collection1/lib/README' to classloader
[junit4:junit4]   2> 2044 T989 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty1-1355278905563/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 2077 T989 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 2143 T989 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 2144 T989 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 2151 T989 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 2384 T972 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2385 T972 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":"control_shard",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:39255_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:39255/solr"}
[junit4:junit4]   2> 2388 T988 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 2388 T971 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 2613 T989 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 2619 T989 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 2622 T989 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 2633 T989 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 2636 T989 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 2639 T989 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 2640 T989 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 2641 T989 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355278905563/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355278903655/jetty1/
[junit4:junit4]   2> 2641 T989 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@8c436b
[junit4:junit4]   2> 2642 T989 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355278903655/jetty1/index/
[junit4:junit4]   2> 2642 T989 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355278903655/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 2643 T989 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355278903655/jetty1/index forceNew:false
[junit4:junit4]   2> 2646 T989 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355278903655/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@a3b5e5),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 2646 T989 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 2646 T989 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 2647 T989 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 2648 T989 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 2648 T989 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 2648 T989 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 2649 T989 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 2649 T989 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 2649 T989 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 2650 T989 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 2651 T989 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 2652 T989 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 2652 T989 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 2653 T989 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 2653 T989 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 2653 T989 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 2654 T989 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 2654 T989 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 2655 T989 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2656 T989 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2657 T989 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2657 T989 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2658 T989 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2659 T989 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2660 T989 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2660 T989 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 2661 T989 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 2663 T989 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 2665 T989 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 2666 T989 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 2668 T989 oass.SolrIndexSearcher.<init> Opening Searcher@758ddb main
[junit4:junit4]   2> 2668 T989 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 2669 T989 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 2669 T989 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 2670 T989 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 2672 T989 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 2696 T990 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@758ddb main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 2703 T989 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 2704 T989 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 2891 T972 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2892 T972 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:40546_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:40546/solr"}
[junit4:junit4]   2> 2892 T972 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4]   2> 2894 T972 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 2896 T971 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 2897 T988 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3205 T989 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 3205 T989 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:40546/solr shardId:shard1
[junit4:junit4]   2> 3206 T989 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 3210 T954 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ceae96a0005 type:delete cxid:0x45 zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 3210 T989 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 3211 T954 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ceae96a0005 type:create cxid:0x46 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3212 T989 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 3212 T989 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 3213 T989 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:40546/solr/collection1/
[junit4:junit4]   2> 3213 T989 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 3214 T989 oasc.SyncStrategy.syncToMe http://127.0.0.1:40546/solr/collection1/ has no replicas
[junit4:junit4]   2> 3214 T989 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:40546/solr/collection1/
[junit4:junit4]   2> 3214 T989 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 3219 T954 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ceae96a0005 type:create cxid:0x50 zxid:0x60 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3399 T972 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3404 T971 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3404 T988 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3420 T989 oasc.ZkController.register We are http://127.0.0.1:40546/solr/collection1/ and leader is http://127.0.0.1:40546/solr/collection1/
[junit4:junit4]   2> 3421 T989 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:40546/solr
[junit4:junit4]   2> 3421 T989 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 3421 T989 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 3421 T989 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 3423 T989 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3423 T949 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 3424 T949 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 3424 T949 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 3483 T949 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 3485 T949 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:33040
[junit4:junit4]   2> 3486 T949 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 3487 T949 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355278907078
[junit4:junit4]   2> 3487 T949 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355278907078/'
[junit4:junit4]   2> 3500 T949 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 3501 T949 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 3501 T949 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355278907078
[junit4:junit4]   2> 3502 T949 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355278907078/solr.xml
[junit4:junit4]   2> 3502 T949 oasc.CoreContainer.<init> New CoreContainer 20137008
[junit4:junit4]   2> 3502 T949 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355278907078/'
[junit4:junit4]   2> 3503 T949 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355278907078/'
[junit4:junit4]   2> 3516 T949 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 3528 T949 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:60112/solr
[junit4:junit4]   2> 3528 T949 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 3529 T949 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60112 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1fd4878
[junit4:junit4]   2> 3530 T1000 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:60112. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 3530 T949 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3530 T1000 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:60112, initiating session
[junit4:junit4]   2> 3531 T951 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:41134
[junit4:junit4]   2> 3531 T951 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:41134
[junit4:junit4]   2> 3532 T953 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8ceae96a0006 with negotiated timeout 20000 for client /127.0.0.1:41134
[junit4:junit4]   2> 3532 T1000 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:60112, sessionid = 0x13b8ceae96a0006, negotiated timeout = 20000
[junit4:junit4]   2> 3532 T1001 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1fd4878 name:ZooKeeperConnection Watcher:127.0.0.1:60112 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3532 T949 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3534 T954 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8ceae96a0006
[junit4:junit4]   2> 3534 T1001 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 3534 T951 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:41134 which had sessionid 0x13b8ceae96a0006
[junit4:junit4]   2> 3534 T949 oaz.ZooKeeper.close Session: 0x13b8ceae96a0006 closed
[junit4:junit4]   2> 3535 T949 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60112/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@1c9144c
[junit4:junit4]   2> 3536 T1002 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:60112. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 3536 T949 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3536 T1002 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:60112, initiating session
[junit4:junit4]   2> 3536 T951 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:41135
[junit4:junit4]   2> 3537 T951 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:41135
[junit4:junit4]   2> 3537 T953 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8ceae96a0007 with negotiated timeout 8000 for client /127.0.0.1:41135
[junit4:junit4]   2> 3537 T1002 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:60112, sessionid = 0x13b8ceae96a0007, negotiated timeout = 8000
[junit4:junit4]   2> 3538 T1003 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c9144c name:ZooKeeperConnection Watcher:127.0.0.1:60112/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3538 T949 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3539 T954 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ceae96a0007 type:create cxid:0x1 zxid:0x6d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3539 T954 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ceae96a0007 type:create cxid:0x2 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3540 T949 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33040_solr
[junit4:junit4]   2> 3541 T954 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ceae96a0007 type:delete cxid:0x4 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:33040_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:33040_solr
[junit4:junit4]   2> 3541 T949 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:33040_solr
[junit4:junit4]   2> 3542 T971 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3543 T988 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 3543 T988 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 3543 T949 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 3543 T971 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 3544 T949 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 3544 T949 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 3544 T949 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 3545 T949 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 3545 T949 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 3546 T949 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 3546 T949 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 3547 T949 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 3547 T949 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 3552 T949 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3557 T1004 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355278907078/collection1
[junit4:junit4]   2> 3558 T1004 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 3558 T1004 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 3558 T1004 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 3559 T1004 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355278907078/collection1/'
[junit4:junit4]   2> 3560 T1004 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty2-1355278907078/collection1/lib/README' to classloader
[junit4:junit4]   2> 3560 T1004 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty2-1355278907078/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 3620 T1004 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 3673 T1004 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 3673 T1004 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 3678 T1004 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 3911 T972 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3912 T972 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:40546_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:40546/solr"}
[junit4:junit4]   2> 3915 T988 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 3915 T971 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 3915 T1003 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4159 T1004 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 4165 T1004 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 4169 T1004 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 4177 T1004 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 4180 T1004 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 4183 T1004 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 4184 T1004 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 4185 T1004 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355278907078/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355278903655/jetty2/
[junit4:junit4]   2> 4185 T1004 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@8c436b
[junit4:junit4]   2> 4186 T1004 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355278903655/jetty2/index/
[junit4:junit4]   2> 4186 T1004 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355278903655/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 4186 T1004 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355278903655/jetty2/index forceNew:false
[junit4:junit4]   2> 4189 T1004 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355278903655/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1833123),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 4190 T1004 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 4190 T1004 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 4191 T1004 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 4192 T1004 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 4192 T1004 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 4192 T1004 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 4192 T1004 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 4193 T1004 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 4193 T1004 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 4194 T1004 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 4194 T1004 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 4195 T1004 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 4196 T1004 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 4196 T1004 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 4197 T1004 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 4197 T1004 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 4197 T1004 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 4198 T1004 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 4199 T1004 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4199 T1004 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4200 T1004 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4201 T1004 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4202 T1004 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4202 T1004 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4203 T1004 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4204 T1004 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 4204 T1004 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 4206 T1004 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 4208 T1004 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 4209 T1004 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 4211 T1004 oass.SolrIndexSearcher.<init> Opening Searcher@fa4a2 main
[junit4:junit4]   2> 4211 T1004 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 4212 T1004 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 4212 T1004 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 4213 T1004 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 4216 T1004 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 4238 T1005 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@fa4a2 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 4244 T1004 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 4244 T1004 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 4418 T972 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4419 T972 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:33040_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:33040/solr"}
[junit4:junit4]   2> 4419 T972 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 4419 T972 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4]   2> 4422 T1003 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4422 T971 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4422 T988 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4746 T1004 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 4747 T1004 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:33040/solr shardId:shard2
[junit4:junit4]   2> 4748 T1004 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4]   2> 4751 T954 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ceae96a0007 type:delete cxid:0x44 zxid:0x7e txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard2 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard2
[junit4:junit4]   2> 4752 T1004 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 4752 T954 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ceae96a0007 type:create cxid:0x45 zxid:0x7f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4753 T1004 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 4754 T1004 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 4754 T1004 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:33040/solr/collection1/
[junit4:junit4]   2> 4754 T1004 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 4754 T1004 oasc.SyncStrategy.syncToMe http://127.0.0.1:33040/solr/collection1/ has no replicas
[junit4:junit4]   2> 4754 T1004 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:33040/solr/collection1/
[junit4:junit4]   2> 4755 T1004 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4]   2> 4757 T954 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ceae96a0007 type:create cxid:0x4e zxid:0x82 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4925 T972 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4930 T971 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4930 T988 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4930 T1003 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4958 T1004 oasc.ZkController.register We are http://127.0.0.1:33040/solr/collection1/ and leader is http://127.0.0.1:33040/solr/collection1/
[junit4:junit4]   2> 4959 T1004 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:33040/solr
[junit4:junit4]   2> 4959 T1004 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 4959 T1004 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 4959 T1004 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 4961 T1004 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4961 T949 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 4962 T949 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 4963 T949 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 5032 T949 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 5035 T949 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:38293
[junit4:junit4]   2> 5036 T949 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 5037 T949 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355278908617
[junit4:junit4]   2> 5038 T949 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355278908617/'
[junit4:junit4]   2> 5057 T949 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 5057 T949 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 5058 T949 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355278908617
[junit4:junit4]   2> 5058 T949 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355278908617/solr.xml
[junit4:junit4]   2> 5059 T949 oasc.CoreContainer.<init> New CoreContainer 23297625
[junit4:junit4]   2> 5059 T949 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355278908617/'
[junit4:junit4]   2> 5060 T949 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355278908617/'
[junit4:junit4]   2> 5073 T949 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 5098 T949 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:60112/solr
[junit4:junit4]   2> 5099 T949 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 5099 T949 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60112 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@ec0362
[junit4:junit4]   2> 5100 T1015 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:60112. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 5100 T949 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 5101 T1015 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:60112, initiating session
[junit4:junit4]   2> 5101 T951 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:41136
[junit4:junit4]   2> 5101 T951 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:41136
[junit4:junit4]   2> 5102 T953 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8ceae96a0008 with negotiated timeout 20000 for client /127.0.0.1:41136
[junit4:junit4]   2> 5102 T1015 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:60112, sessionid = 0x13b8ceae96a0008, negotiated timeout = 20000
[junit4:junit4]   2> 5102 T1016 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ec0362 name:ZooKeeperConnection Watcher:127.0.0.1:60112 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 5103 T949 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 5104 T954 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8ceae96a0008
[junit4:junit4]   2> 5104 T1016 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 5104 T951 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:41136 which had sessionid 0x13b8ceae96a0008
[junit4:junit4]   2> 5104 T949 oaz.ZooKeeper.close Session: 0x13b8ceae96a0008 closed
[junit4:junit4]   2> 5105 T949 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60112/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@11f9f60
[junit4:junit4]   2> 5106 T1017 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:60112. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 5106 T949 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 5106 T1017 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:60112, initiating session
[junit4:junit4]   2> 5107 T951 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:41137
[junit4:junit4]   2> 5107 T951 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:41137
[junit4:junit4]   2> 5107 T953 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8ceae96a0009 with negotiated timeout 8000 for client /127.0.0.1:41137
[junit4:junit4]   2> 5108 T1017 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:60112, sessionid = 0x13b8ceae96a0009, negotiated timeout = 8000
[junit4:junit4]   2> 5108 T1018 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@11f9f60 name:ZooKeeperConnection Watcher:127.0.0.1:60112/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 5108 T949 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 5109 T954 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ceae96a0009 type:create cxid:0x1 zxid:0x8f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5110 T954 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ceae96a0009 type:create cxid:0x2 zxid:0x90 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5110 T949 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38293_solr
[junit4:junit4]   2> 5111 T954 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ceae96a0009 type:delete cxid:0x4 zxid:0x91 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:38293_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:38293_solr
[junit4:junit4]   2> 5111 T949 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:38293_solr
[junit4:junit4]   2> 5113 T971 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5113 T1003 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 5113 T988 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 5113 T1003 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5113 T988 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5113 T949 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 5114 T971 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 5115 T949 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 5115 T949 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 5115 T949 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 5116 T949 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 5116 T949 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 5117 T949 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 5117 T949 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 5118 T949 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 5118 T949 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 5123 T949 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 5131 T1019 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355278908617/collection1
[junit4:junit4]   2> 5132 T1019 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 5132 T1019 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 5132 T1019 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 5133 T1019 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355278908617/collection1/'
[junit4:junit4]   2> 5134 T1019 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty3-1355278908617/collection1/lib/README' to classloader
[junit4:junit4]   2> 5134 T1019 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty3-1355278908617/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 5186 T1019 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 5247 T1019 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 5248 T1019 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 5253 T1019 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 5441 T972 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5442 T972 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:33040_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:33040/solr"}
[junit4:junit4]   2> 5445 T988 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5445 T1018 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5445 T971 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5445 T1003 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5743 T1019 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 5749 T1019 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 5752 T1019 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 5761 T1019 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5764 T1019 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5767 T1019 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5768 T1019 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5769 T1019 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355278908617/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355278903655/jetty3/
[junit4:junit4]   2> 5769 T1019 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@8c436b
[junit4:junit4]   2> 5770 T1019 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355278903655/jetty3/index/
[junit4:junit4]   2> 5770 T1019 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355278903655/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 5771 T1019 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355278903655/jetty3/index forceNew:false
[junit4:junit4]   2> 5774 T1019 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355278903655/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@5fb7e4),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 5774 T1019 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 5774 T1019 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 5776 T1019 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 5776 T1019 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 5776 T1019 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 5777 T1019 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 5777 T1019 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 5777 T1019 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 5778 T1019 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 5778 T1019 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 5779 T1019 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 5780 T1019 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 5781 T1019 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 5781 T1019 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 5782 T1019 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 5782 T1019 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 5782 T1019 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 5783 T1019 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 5784 T1019 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5784 T1019 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5785 T1019 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5786 T1019 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5786 T1019 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5787 T1019 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5788 T1019 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5789 T1019 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 5789 T1019 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 5791 T1019 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 5793 T1019 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 5804 T1019 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 5806 T1019 oass.SolrIndexSearcher.<init> Opening Searcher@8e5ba main
[junit4:junit4]   2> 5807 T1019 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 5807 T1019 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 5808 T1019 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 5808 T1019 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 5811 T1019 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 5833 T1020 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@8e5ba main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 5839 T1019 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 5839 T1019 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 5948 T972 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5949 T972 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:38293_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:38293/solr"}
[junit4:junit4]   2> 5949 T972 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 5949 T972 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 5952 T1018 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5952 T1003 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5952 T988 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5953 T971 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6341 T1019 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 6341 T1019 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:38293/solr shardId:shard1
[junit4:junit4]   2> 6344 T1019 oasc.ZkController.register We are http://127.0.0.1:38293/solr/collection1/ and leader is http://127.0.0.1:40546/solr/collection1/
[junit4:junit4]   2> 6344 T1019 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:38293/solr
[junit4:junit4]   2> 6344 T1019 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 6344 T1019 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C101 name=collection1 org.apache.solr.core.SolrCore@1133cac url=http://127.0.0.1:38293/solr/collection1 node=127.0.0.1:38293_solr
[junit4:junit4]   2> 6348 T1021 C101 P38293 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 6349 T1019 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6350 T1021 C101 P38293 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 6350 T1021 C101 P38293 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 6350 T1021 C101 P38293 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 6350 T949 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 6351 T949 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 6352 T1021 C101 P38293 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:40546/solr/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 6352 T949 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 6356 T1021 C101 P38293 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4]   2> 6361 T1021 C101 P38293 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:38293/solr START replicas=[http://127.0.0.1:40546/solr/collection1/] nUpdates=100
[junit4:junit4]   2> 6362 T1021 C101 P38293 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 6364 T1021 C101 P38293 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 6364 T1021 C101 P38293 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 6364 T1021 C101 P38293 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C102 name=collection1 org.apache.solr.core.SolrCore@117f2e0 url=http://127.0.0.1:40546/solr/collection1 node=127.0.0.1:40546_solr
[junit4:junit4]   2> 6371 T982 C102 P40546 REQ /get {distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=0 
[junit4:junit4]   2> 6441 T949 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 6444 T949 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:48480
[junit4:junit4]   2> 6445 T949 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 6446 T949 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355278910007
[junit4:junit4]   2> 6446 T949 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355278910007/'
[junit4:junit4]   2> 6456 T972 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6457 T972 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:38293_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:38293/solr"}
[junit4:junit4]   2> 6459 T1018 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6460 T988 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6460 T1003 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6460 T971 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6468 T949 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 6469 T949 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 6470 T949 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355278910007
[junit4:junit4]   2> 6470 T949 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355278910007/solr.xml
[junit4:junit4]   2> 6471 T949 oasc.CoreContainer.<init> New CoreContainer 1624110
[junit4:junit4]   2> 6472 T949 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355278910007/'
[junit4:junit4]   2> 6472 T949 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355278910007/'
[junit4:junit4]   2> 6487 T949 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 6498 T949 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:60112/solr
[junit4:junit4]   2> 6499 T949 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 6499 T949 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60112 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@4e4cdb
[junit4:junit4]   2> 6500 T949 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6500 T1032 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:60112. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 6501 T1032 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:60112, initiating session
[junit4:junit4]   2> 6501 T951 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:41140
[junit4:junit4]   2> 6502 T951 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:41140
[junit4:junit4]   2> 6502 T953 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8ceae96a000a with negotiated timeout 20000 for client /127.0.0.1:41140
[junit4:junit4]   2> 6502 T1032 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:60112, sessionid = 0x13b8ceae96a000a, negotiated timeout = 20000
[junit4:junit4]   2> 6503 T1033 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4e4cdb name:ZooKeeperConnection Watcher:127.0.0.1:60112 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6503 T949 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6504 T954 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8ceae96a000a
[junit4:junit4]   2> 6505 T1033 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 6505 T951 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:41140 which had sessionid 0x13b8ceae96a000a
[junit4:junit4]   2> 6505 T949 oaz.ZooKeeper.close Session: 0x13b8ceae96a000a closed
[junit4:junit4]   2> 6506 T949 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60112/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@105db37
[junit4:junit4]   2> 6507 T1034 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:60112. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 6507 T949 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6508 T951 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:41141
[junit4:junit4]   2> 6508 T1034 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:60112, initiating session
[junit4:junit4]   2> 6508 T951 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:41141
[junit4:junit4]   2> 6509 T953 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8ceae96a000b with negotiated timeout 8000 for client /127.0.0.1:41141
[junit4:junit4]   2> 6509 T1034 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:60112, sessionid = 0x13b8ceae96a000b, negotiated timeout = 8000
[junit4:junit4]   2> 6509 T1035 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@105db37 name:ZooKeeperConnection Watcher:127.0.0.1:60112/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6509 T949 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6510 T954 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ceae96a000b type:create cxid:0x1 zxid:0xa6 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6511 T954 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ceae96a000b type:create cxid:0x2 zxid:0xa7 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6512 T949 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48480_solr
[junit4:junit4]   2> 6512 T954 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8ceae96a000b type:delete cxid:0x4 zxid:0xa8 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:48480_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:48480_solr
[junit4:junit4]   2> 6513 T949 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:48480_solr
[junit4:junit4]   2> 6515 T971 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6515 T1018 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6515 T1003 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 6515 T988 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 6516 T1003 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6516 T988 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6517 T949 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 6518 T1018 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 6517 T971 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 6518 T949 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 6518 T949 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 6519 T949 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 6519 T949 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 6520 T949 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 6520 T949 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 6521 T949 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 6521 T949 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 6522 T949 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 6526 T949 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 6532 T1036 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355278910007/collection1
[junit4:junit4]   2> 6533 T1036 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 6533 T1036 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 6533 T1036 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 6534 T1036 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355278910007/collection1/'
[junit4:junit4]   2> 6535 T1036 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty4-1355278910007/collection1/lib/README' to classloader
[junit4:junit4]   2> 6535 T1036 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty4-1355278910007/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 6569 T1036 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 6637 T1036 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 6637 T1036 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 6643 T1036 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 7109 T1036 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 7116 T1036 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 7119 T1036 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 7128 T1036 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 7131 T1036 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 7134 T1036 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 7135 T1036 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 7136 T1036 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355278910007/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355278903655/jetty4/
[junit4:junit4]   2> 7137 T1036 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@8c436b
[junit4:junit4]   2> 7137 T1036 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355278903655/jetty4/index/
[junit4:junit4]   2> 7137 T1036 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355278903655/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 7138 T1036 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355278903655/jetty4/index forceNew:false
[junit4:junit4]   2> 7140 T1036 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355278903655/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@175e1a2),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 7141 T1036 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 7141 T1036 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 7143 T1036 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 7144 T1036 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 7144 T1036 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 7144 T1036 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 7145 T1036 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 7145 T1036 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 7146 T1036 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 7147 T1036 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 7147 T1036 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 7148 T1036 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 7149 T1036 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 7149 T1036 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 7150 T1036 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 7150 T1036 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 7150 T1036 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 7151 T1036 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 7152 T1036 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7152 T1036 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7153 T1036 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7154 T1036 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7154 T1036 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7155 T1036 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7156 T1036 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7157 T1036 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 7158 T1036 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 7160 T1036 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 7161 T1036 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 7163 T1036 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 7165 T1036 oass.SolrIndexSearcher.<init> Opening Searcher@571c1 main
[junit4:junit4]   2> 7165 T1036 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 7166 T1036 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 7166 T1036 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 7166 T1036 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 7169 T1036 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 7193 T1037 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@571c1 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 7198 T1036 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 7198 T1036 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 7465 T972 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7465 T972 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:48480_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:48480/solr"}
[junit4:junit4]   2> 7465 T972 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 7466 T972 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4]   2> 7468 T1018 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7468 T988 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7468 T1003 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7468 T971 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7468 T1035 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7700 T1036 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 7701 T1036 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:48480/solr shardId:shard2
[junit4:junit4]   2> 7704 T1036 oasc.ZkController.register We are http://127.0.0.1:48480/solr/collection1/ and leader is http://127.0.0.1:33040/solr/collection1/
[junit4:junit4]   2> 7704 T1036 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:48480/solr
[junit4:junit4]   2> 7704 T1036 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 7704 T1036 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C103 name=collection1 org.apache.solr.core.SolrCore@fc3212 url=http://127.0.0.1:48480/solr/collection1 node=127.0.0.1:48480_solr
[junit4:junit4]   2> 7705 T1038 C103 P48480 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 7706 T1038 C103 P48480 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 7705 T1036 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7706 T1038 C103 P48480 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 7706 T1038 C103 P48480 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 7706 T949 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 7707 T1038 C103 P48480 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:33040/solr/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 7707 T949 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 7707 T1038 C103 P48480 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:48480/solr START replicas=[http://127.0.0.1:33040/solr/collection1/] nUpdates=100
[junit4:junit4]   2> 7708 T949 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 7708 T1038 C103 P48480 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 7709 T1038 C103 P48480 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 7710 T1038 C103 P48480 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 7710 T1038 C103 P48480 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 7713 T949 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60112/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@758e43
[junit4:junit4]   2> 7714 T1040 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:60112. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 7714 T949 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 7715 T1040 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:60112, initiating session
[junit4:junit4]   2> 7715 T951 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:41144
[junit4:junit4]   2> 7715 T951 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:41144
[junit4:junit4]   2> 7716 T953 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8ceae96a000c with negotiated timeout 10000 for client /127.0.0.1:41144
[junit4:junit4]   2> 7716 T1040 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:60112, sessionid = 0x13b8ceae96a000c, negotiated timeout = 10000
[junit4:junit4]   2> ASYNC  NEW_CORE C104 name=collection1 org.apache.solr.core.SolrCore@18e676c url=http://127.0.0.1:33040/solr/collection1 node=127.0.0.1:33040_solr
[junit4:junit4]   2> 7717 T999 C104 P33040 REQ /get {distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=1 
[junit4:junit4]   2> 7717 T1041 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@758e43 name:ZooKeeperConnection Watcher:127.0.0.1:60112/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 7717 T949 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 7718 T949 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 7721 T949 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 7722 T949 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 7726 T949 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7728 T949 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):540
[junit4:junit4]   2> 7728 T949 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7972 T972 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7973 T972 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:48480_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:48480/solr"}
[junit4:junit4]   2> 7976 T1035 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7976 T1003 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7976 T988 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7976 T1018 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7976 T971 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 7977 T1041 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8730 T949 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2>  C101_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:38293_solr, base_url=http://127.0.0.1:38293/solr}
[junit4:junit4]   2> 9370 T1021 C101 P38293 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 9371 T1021 C101 P38293 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 9371 T1021 C101 P38293 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:40546/solr/collection1/. core=collection1
[junit4:junit4]   2> 9371 T1021 C101 P38293 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 9375 T982 C102 P40546 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 9377 T982 C102 P40546 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355278903655/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@a3b5e5),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 9378 T982 C102 P40546 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 9386 T982 C102 P40546 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355278903655/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@a3b5e5),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355278903655/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@a3b5e5),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 9387 T982 C102 P40546 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 9387 T982 C102 P40546 oass.SolrIndexSearcher.<init> Opening Searcher@5e7937 realtime
[junit4:junit4]   2> 9388 T982 C102 P40546 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 9388 T982 C102 P40546 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 9389 T982 C102 P40546 /update {waitSearcher=true&openSearcher=false&commit=true&commit_end_point=true&wt=javabin&softCommit=false&version=2} {commit=} 0 15
[junit4:junit4]   2> 9391 T1021 C101 P38293 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 9391 T1021 C101 P38293 oascsi.HttpClientUtil.createClient Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
[junit4:junit4]   2> 9396 T1021 C101 P38293 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 9398 T984 C102 P40546 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 9399 T984 C102 P40546 REQ /replication {command=indexversion&wt=javabin&qt=/replication&version=2} status=0 QTime=2 
[junit4:junit4]   2> 9400 T1021 C101 P38293 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 9400 T1021 C101 P38293 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 9400 T1021 C101 P38293 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 9402 T983 C102 P40546 REQ /replication {command=filelist&generation=2&wt=javabin&qt=/replication&version=2} status=0 QTime=0 
[junit4:junit4]   2> 9403 T1021 C101 P38293 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 9404 T1021 C101 P38293 oash.SnapPuller.fetchLatestIndex Starting download to ./org.apache.solr.cloud.BasicDistributedZkTest-1355278903655/jetty3/index.20121211192153055 fullCopy=true
[junit4:junit4]   2> 9409 T982 C102 P40546 REQ /replication {file=segments_2&command=filecontent&checksum=true&generation=2&qt=/replication&wt=filestream} status=0 QTime=1 
[junit4:junit4]   2> 9415 T1021 C101 P38293 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 9426 T1021 C101 P38293 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20121211192153055
[junit4:junit4]   2> 9427 T1021 C101 P38293 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.BasicDistributedZkTest-1355278903655/jetty3/index/ new=./org.apache.solr.cloud.BasicDistributedZkTest-1355278903655/jetty3/index.20121211192153055
[junit4:junit4]   2> 9428 T1021 C101 P38293 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355278903655/jetty3/index.20121211192153055 forceNew:false
[junit4:junit4]   2> 9429 T1021 C101 P38293 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355278903655/jetty3/index.20121211192153055 lockFactory=org.apache.lucene.store.NativeFSLockFactory@d25603),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 9429 T1021 C101 P38293 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 9431 T1021 C101 P38293 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 9431 T1021 C101 P38293 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 9431 T1021 C101 P38293 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4]   2> 9432 T1021 C101 P38293 oasc.CachingDirectoryFactory.close Closing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355278903655/jetty3/index.20121211192153055
[junit4:junit4]   2> 9432 T1021 C101 P38293 oash.SnapPuller$2.onClose removing old index directory ./org.apache.solr.cloud.BasicDistributedZkTest-1355278903655/jetty3/index
[junit4:junit4]   2> 9433 T1021 C101 P38293 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355278903655/jetty3/index.20121211192153055 forceNew:true
[junit4:junit4]   2> 9434 T1021 C101 P38293 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355278903655/jetty3/index.20121211192153055 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1663156),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 9434 T1021 C101 P38293 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 9435 T1021 C101 P38293 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 9435 T1021 C101 P38293 oass.SolrIndexSearcher.<init> Opening Searcher@11684d5 main
[junit4:junit4]   2> 9435 T1021 C101 P38293 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 9437 T1020 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@11684d5 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 9438 T1021 C101 P38293 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 9467 T1021 C101 P38293 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355278903655/jetty3/index.20121211192153055 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1663156),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355278903655/jetty3/index.20121211192153055 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1663156),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 9468 T1021 C101 P38293 oasc.SolrDeletionPolicy.updateCommits newest commit = 3
[junit4:junit4]   2> 9468 T1021 C101 P38293 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 9468 T1021 C101 P38293 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 9469 T1021 C101 P38293 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 9469 T1021 C101 P38293 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 9469 T1021 C101 P38293 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 9470 T1021 C101 P38293 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 9483 T972 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9484 T972 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:38293_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:38293/solr"}
[junit4:junit4]   2> 9496 T1003 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9496 T1041 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9496 T1018 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9496 T971 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9497 T1035 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9496 T988 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9732 T949 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2>  C103_STATE=coll:collection1 core:collection1 props:{shard=shard2, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:48480_solr, base_url=http://127.0.0.1:48480/solr}
[junit4:junit4]   2> 10715 T1038 C103 P48480 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 10715 T1038 C103 P48480 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 10715 T1038 C103 P48480 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:33040/solr/collection1/. core=collection1
[junit4:junit4]   2> 10716 T1038 C103 P48480 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 10719 T996 C104 P33040 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 10721 T996 C104 P33040 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355278903655/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1833123),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 10722 T996 C104 P33040 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 10726 T996 C104 P33040 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355278903655/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1833123),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355278903655/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1833123),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 10726 T996 C104 P33040 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 10727 T996 C104 P33040 oass.SolrIndexSearcher.<init> Opening Searcher@1440014 realtime
[junit4:junit4]   2> 10727 T996 C104 P33040 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 10728 T996 C104 P33040 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 10728 T996 C104 P33040 /update {waitSearcher=true&openSearcher=false&commit=true&commit_end_point=true&wt=javabin&softCommit=false&version=2} {commit=} 0 9
[junit4:junit4]   2> 10729 T1038 C103 P48480 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 10729 T1038 C103 P48480 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 10732 T999 C104 P33040 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 10732 T999 C104 P33040 REQ /replication {command=indexversion&wt=javabin&qt=/replication&version=2} status=0 QTime=1 
[junit4:junit4]   2> 10733 T1038 C103 P48480 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 10733 T1038 C103 P48480 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 10733 T1038 C103 P48480 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 10734 T949 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10735 T996 C104 P33040 REQ /replication {command=filelist&generation=2&wt=javabin&qt=/replication&version=2} status=0 QTime=0 
[junit4:junit4]   2> 10735 T1038 C103 P48480 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 10736 T1038 C103 P48480 oash.SnapPuller.fetchLatestIndex Starting download to ./org.apache.solr.cloud.BasicDistributedZkTest-1355278903655/jetty4/index.20121211192154387 fullCopy=true
[junit4:junit4]   2> 10738 T997 C104 P33040 REQ /replication {file=segments_2&command=filecontent&checksum=true&generation=2&qt=/replication&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 10740 T1038 C103 P48480 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 10746 T1038 C103 P48480 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20121211192154387
[junit4:junit4]   2> 10746 T1038 C103 P48480 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.BasicDistributedZkTest-1355278903655/jetty4/index/ new=./org.apache.solr.cloud.BasicDistributedZkTest-1355278903655/jetty4/index.20121211192154387
[junit4:junit4]   2> 10747 T1038 C103 P48480 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355278903655/jetty4/index.20121211192154387 forceNew:false
[junit4:junit4]   2> 10748 T1038 C103 P48480 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355278903655/jetty4/index.20121211192154387 lockFactory=org.apache.lucene.store.NativeFSLockFactory@15e0f30),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 10749 T1038 C103 P48480 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 10749 T1038 C103 P48480 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 10749 T1038 C103 P48480 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 10749 T1038 C103 P48480 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4]   2> 10750 T1038 C103 P48480 oasc.CachingDirectoryFactory.close Closing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355278903655/jetty4/index.20121211192154387
[junit4:junit4]   2> 10750 T1038 C103 P48480 oash.SnapPuller$2.onClose removing old index directory ./org.apache.solr.cloud.BasicDistributedZkTest-1355278903655/jetty4/index
[junit4:junit4]   2> 10751 T1038 C103 P48480 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355278903655/jetty4/index.20121211192154387 forceNew:true
[junit4:junit4]   2> 10752 T1038 C103 P48480 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355278903655/jetty4/index.20121211192154387 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2c13ed),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 10752 T1038 C103 P48480 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 10753 T1038 C103 P48480 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 10753 T1038 C103 P48480 oass.SolrIndexSearcher.<init> Opening Searcher@d4b6c4 main
[junit4:junit4]   2> 10753 T1038 C103 P48480 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 10755 T1037 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@d4b6c4 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 10756 T1038 C103 P48480 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 10777 T1038 C103 P48480 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355278903655/jetty4/index.20121211192154387 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2c13ed),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355278903655/jetty4/index.20121211192154387 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2c13ed),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 10778 T1038 C103 P48480 oasc.SolrDeletionPolicy.updateCommits newest commit = 3
[junit4:junit4]   2> 10778 T1038 C103 P48480 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 10778 T1038 C103 P48480 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 10779 T1038 C103 P48480 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 10779 T1038 C103 P48480 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 10779 T1038 C103 P48480 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 10780 T1038 C103 P48480 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 11003 T972 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 11004 T972 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:48480_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:48480/solr"}
[junit4:junit4]   2> 11007 T1018 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 11007 T1035 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 11007 T971 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 11007 T988 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 11007 T1003 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 11007 T1041 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 11736 T949 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> ASYNC  NEW_CORE C105 name=collection1 org.apache.solr.core.SolrCore@8c4906 url=http://127.0.0.1:39255/solr/collection1 node=127.0.0.1:39255_solr
[junit4:junit4]   2> 11743 T965 C105 P39255 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355278903655/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1b8d279),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 11744 T965 C105 P39255 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 11745 T965 C105 P39255 oass.SolrIndexSearcher.<init> Opening Searcher@1972db9 realtime
[junit4:junit4]   2> 11746 T965 C105 P39255 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 11746 T965 C105 P39255 /update {wt=javabin&version=2} {deleteByQuery=*:* (-1421112943987130368)} 0 4
[junit4:junit4]   2> 11747 T949 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60112/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@3afdb6
[junit4:junit4]   2> 11748 T1044 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:60112. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 11748 T949 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 11748 T1044 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:60112, initiating session
[junit4:junit4]   2> 11748 T951 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:41153
[junit4:junit4]   2> 11749 T951 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:41153
[junit4:junit4]   2> 11749 T953 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8ceae96a000d with negotiated timeout 10000 for client /127.0.0.1:41153
[junit4:junit4]   2> 11749 T1044 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:60112, sessionid = 0x13b8ceae96a000d, negotiated timeout = 10000
[junit4:junit4]   2> 11749 T1045 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3afdb6 name:ZooKeeperConnection Watcher:127.0.0.1:60112/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 11750 T949 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 11750 T949 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2>  C101_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:38293_solr, base_url=http://127.0.0.1:38293/solr}
[junit4:junit4]   2> 11760 T1014 C101 P38293 REQ /update {update.distrib=FROMLEADER&_version_=-1421112943998664704&update.from=http://127.0.0.1:40546/solr/collection1/&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2>  C103_STATE=coll:collection1 core:collection1 props:{shard=shard2, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:48480_solr, base_url=http://127.0.0.1:48480/solr}
[junit4:junit4]   2> 11762 T1031 C103 P48480 REQ /update {update.distrib=FROMLEADER&_version_=-1421112944000761856&update.from=http://127.0.0.1:33040/solr/collection1/&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 11763 T998 C104 P33040 REQ /update {update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=8 
[junit4:junit4]   2> 11763 T982 C102 P40546 /update {wt=javabin&version=2} {deleteByQuery=*:* (-1421112943998664704)} 0 10
[junit4:junit4]   2> 11768 T966 C105 P39255 /update {wt=javabin&version=2} {add=[1 (1421112944012296192)]} 0 2
[junit4:junit4]   2> 11779 T1011 C101 P38293 REQ /update {distrib.from=http://127.0.0.1:40546/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 11779 T984 C102 P40546 REQ /update {distrib.from=http://127.0.0.1:33040/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=6 
[junit4:junit4]   2> 11780 T999 C104 P33040 /update {wt=javabin&version=2} {add=[1]} 0 10
[junit4:junit4]   2> 11783 T967 C105 P39255 /update {wt=javabin&version=2} {add=[2 (1421112944029073408)]} 0 1
[junit4:junit4]   2> 11791 T1028 C103 P48480 REQ /update {distrib.from=http://127.0.0.1:33040/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 11791 T996 C104 P33040 /update {wt=javabin&version=2} {add=[2 (1421112944032219136)]} 0 6
[junit4:junit4]   2> 11794 T964 C105 P39255 /update {wt=javabin&version=2} {add=[3 (1421112944040607744)]} 0 1
[junit4:junit4]   2> 11801 T1029 C103 P48480 REQ /update {distrib.from=http://127.0.0.1:33040/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11802 T997 C104 P33040 REQ /update {distrib.from=http://127.0.0.1:40546/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=4 
[junit4:junit4]   2> 11802 T983 C102 P40546 /update {wt=javabin&version=2} {add=[3]} 0 6
[junit4:junit4]   2> 11805 T965 C105 P39255 /update {wt=javabin&version=2} {add=[4 (1421112944052142080)]} 0 1
[junit4:junit4]   2> 11812 T1012 C101 P38293 REQ /update {distrib.from=http://127.0.0.1:40546/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11813 T981 C102 P40546 REQ /update {distrib.from=http://127.0.0.1:33040/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=4 
[junit4:junit4]   2> 11813 T998 C104 P33040 /update {wt=javabin&version=2} {add=[4]} 0 6
[junit4:junit4]   2> 11816 T966 C105 P39255 /update {wt=javabin&version=2} {add=[5 (1421112944063676416)]} 0 1
[junit4:junit4]   2> 11823 T1030 C103 P48480 REQ /update {distrib.from=http://127.0.0.1:33040/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11823 T999 C104 P33040 REQ /update {distrib.from=http://127.0.0.1:40546/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=4 
[junit4:junit4]   2> 11824 T984 C102 P40546 /update {wt=javabin&version=2} {add=[5]} 0 6
[junit4:junit4]   2> 11826 T967 C105 P39255 /update {wt=javabin&version=2} {add=[6 (1421112944075210752)]} 0 0
[junit4:junit4]   2> 11833 T1031 C103 P48480 REQ /update {distrib.from=http://127.0.0.1:33040/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11834 T996 C104 P33040 REQ /update {distrib.from=http://127.0.0.1:40546/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=4 
[junit4:junit4]   2> 11834 T982 C102 P40546 /update {wt=javabin&version=2} {add=[6]} 0 6
[junit4:junit4]   2> 11837 T964 C105 P39255 /update {wt=javabin&version=2} {add=[7 (1421112944086745088)]} 0 1
[junit4:junit4]   2> 11844 T1028 C103 P48480 REQ /update {distrib.from=http://127.0.0.1:33040/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11844 T997 C104 P33040 REQ /update {distrib.from=http://127.0.0.1:40546/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=3 
[junit4:junit4]   2> 11845 T983 C102 P40546 /update {wt=javabin&version=2} {add=[7]} 0 6
[junit4:junit4]   2> 11847 T965 C105 P39255 /update {wt=javabin&version=2} {add=[8 (1421112944097230848)]} 0 0
[junit4:junit4]   2> 11852 T1014 C101 P38293 REQ /update {distrib.from=http://127.0.0.1:40546/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 11853 T981 C102 P40546 /update {wt=javabin&version=2} {add=[8 (1421112944099328000)]} 0 4
[junit4:junit4]   2> 11856 T966 C105 P39255 /update {wt=javabin&version=2} {add=[9 (1421112944105619456)]} 0 1
[junit4:junit4]   2> 11861 T1029 C103 P48480 REQ /update {distrib.from=http://127.0.0.1:33040/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11861 T998 C104 P33040 /update {wt=javabin&version=2} {add=[9 (1421112944108765184)]} 0 3
[junit4:junit4]   2> 11868 T967 C105 P39255 /update {wt=javabin&version=2} {add=[10 (1421112944115056640)]} 0 4
[junit4:junit4]   2> 11894 T1012 C101 P38293 REQ /update {distrib.from=http://127.0.0.1:40546/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11894 T984 C102 P40546 REQ /update {distrib.from=http://127.0.0.1:33040/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=22 
[junit4:junit4]   2> 11895 T999 C104 P33040 /update {wt=javabin&version=2} {add=[10]} 0 25
[junit4:junit4]   2> 11899 T965 C105 P39255 /update {wt=javabin&version=2} {add=[11 (1421112944149659648)]} 0 2
[junit4:junit4]   2> 11907 T1013 C101 P38293 REQ /update {distrib.from=http://127.0.0.1:40546/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11907 T982 C102 P40546 REQ /update {distrib.from=http://127.0.0.1:33040/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=4 
[junit4:junit4]   2> 11908 T996 C104 P33040 /update {wt=javabin&version=2} {add=[11]} 0 7
[junit4:junit4]   2> 11911 T967 C105 P39255 /update {wt=javabin&version=2} {add=[12 (1421112944163291136)]} 0 1
[junit4:junit4]   2> 11917 T1011 C101 P38293 REQ /update {distrib.from=http://127.0.0.1:40546/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11917 T983 C102 P40546 /update {wt=javabin&version=2} {add=[12 (1421112944166436864)]} 0 4
[junit4:junit4]   2> 11921 T964 C105 P39255 /update {wt=javabin&version=2} {add=[13 (1421112944173776896)]} 0 2
[junit4:junit4]   2> 11925 T1014 C101 P38293 REQ /update {distrib.from=http://127.0.0.1:40546/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 11926 T981 C102 P40546 /update {wt=javabin&version=2} {add=[13 (1421112944176922624)]} 0 4
[junit4:junit4]   2> 11929 T966 C105 P39255 /update {wt=javabin&version=2} {add=[14 (1421112944182165504)]} 0 1
[junit4:junit4]   2> 11935 T1012 C101 P38293 REQ /update {distrib.from=http://127.0.0.1:40546/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 11936 T984 C102 P40546 REQ /update {distrib.from=http://127.0.0.1:33040/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=4 
[junit4:junit4]   2> 11936 T997 C104 P33040 /update {wt=javabin&version=2} {add=[14]} 0 5
[junit4:junit4]   2> 11939 T965 C105 P39255 /update {wt=javabin&version=2} {add=[15 (1421112944192651264)]} 0 1
[junit4:junit4]   2> 11946 T1013 C101 P38293 REQ /update {distrib.from=http://127.0.0.1:40546/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11946 T982 C102 P40546 REQ /update {distrib.from=http://127.0.0.1:33040/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=3 
[junit4:junit4]   2> 11947 T998 C104 P33040 /update {wt=javabin&version=2} {add=[15]} 0 6
[junit4:junit4]   2> 11949 T967 C105 P39255 /update {wt=javabin&version=2} {add=[16 (1421112944204185600)]} 0 0
[junit4:junit4]   2> 11966 T1011 C101 P38293 REQ /update {distrib.from=http://127.0.0.1:40546/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=4 
[junit4:junit4]   2> 11967 T983 C102 P40546 REQ /update {distrib.from=http://127.0.0.1:33040/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=14 
[junit4:junit4]   2> 11968 T996 C104 P33040 /update {wt=javabin&version=2} {add=[16]} 0 17
[junit4:junit4]   2> 11973 T964 C105 P39255 /update {wt=javabin&version=2} {add=[17 (1421112944227254272)]} 0 3
[junit4:junit4]   2> 11980 T1030 C103 P48480 REQ /update {distrib.from=http://127.0.0.1:33040/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 11981 T997 C104 P33040 /update {wt=javabin&version=2} {add=[17 (1421112944231448576)]} 0 6
[junit4:junit4]   2> 11984 T966 C105 P39255 /update {wt=javabin&version=2} {add=[100 (1421112944239837184)]} 0 1
[junit4:junit4]   2> 11990 T1014 C101 P38293 REQ /update {distrib.from=http://127.0.0.1:40546/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 11990 T981 C102 P40546 /update {wt=javabin&version=2} {add=[100 (1421112944242982912)]} 0 4
[junit4:junit4]   2> 11993 T965 C105 P39255 /update {wt=javabin&version=2} {add=[101 (1421112944249274368)]} 0 1
[junit4:junit4]   2> 11997 T1012 C101 P38293 REQ /update {distrib.from=http://127.0.0.1:40546/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 11998 T984 C102 P40546 /update {wt=javabin&version=2} {add=[101 (1421112944252420096)]} 0 3
[junit4:junit4]   2> 12007 T967 C105 P39255 /update {wt=javabin&version=2} {add=[102 (1421112944257662976)]} 0 7
[junit4:junit4]   2> 12012 T1013 C101 P38293 REQ /update {distrib.from=http://127.0.0.1:40546/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 12013 T982 C102 P40546 /update {wt=javabin&version=2} {add=[102 (1421112944268148736)]} 0 3
[junit4:junit4]   2> 12016 T964 C105 P39255 /update {wt=javabin&version=2} {add=[103 (1421112944273391616)]} 0 1
[junit4:junit4]   2> 12023 T1031 C103 P48480 REQ /update {distrib.from=http://127.0.0.1:33040/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 12024 T998 C104 P33040 REQ /update {distrib.from=http://127.0.0.1:40546/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=4 
[junit4:junit4]   2> 12024 T983 C102 P40546 /update {wt=javabin&version=2} {add=[103]} 0 6
[junit4:junit4]   2> 12027 T966 C105 P39255 /update {wt=javabin&version=2} {add=[104 (1421112944284925952)]} 0 1
[junit4:junit4]   2> 12034 T1028 C103 P48480 REQ /update {distrib.from=http://127.0.0.1:33040/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 12034 T996 C104 P33040 REQ /update {distrib.from=http://127.0.0.1:40546/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=4 
[junit4:junit4]   2> 12035 T981 C102 P40546 /update {wt=javabin&version=2} {add=[104]} 0 6
[junit4:junit4]   2> 12037 T965 C105 P39255 /update {wt=javabin&version=2} {add=[105 (1421112944296460288)]} 0 0
[junit4:junit4]   2> 12054 T1029 C103 P48480 REQ /update {distrib.from=http://127.0.0.1:33040/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=9 
[junit4:junit4]   2> 12055 T997 C104 P33040 /update {wt=javabin&version=2} {add=[105 (1421112944298557440)]} 0 16
[junit4:junit4]   2> 12059 T967 C105 P39255 /update {wt=javabin&version=2} {add=[106 (1421112944318480384)]} 0 2
[junit4:junit4]   2> 12068 T1031 C103 P48480 REQ /update {distrib.from=http://127.0.0.1:33040/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 12069 T999 C104 P33040 /update {wt=javabin&version=2} {add=[106 (1421112944322674688)]} 0 8
[junit4:junit4]   2> 12074 T964 C105 P39255 /update {wt=javabin&version=2} {add=[107 (1421112944333160448)]} 0 2
[junit4:junit4]   2> 12082 T1011 C101 P38293 REQ /update {distrib.from=http://127.0.0.1:40546/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 12082 T984 C102 P40546 REQ /update {distrib.from=http://127.0.0.1:33040/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=3 
[junit4:junit4]   2> 12083 T998 C104 P33040 /update {wt=javabin&version=2} {add=[107]} 0 6
[junit4:junit4]   2> 12085 T966 C105 P39255 /update {wt=javabin&version=2} {add=[108 (1421112944346791936)]} 0 0
[junit4:junit4]   2> 12092 T1014 C101 P38293 REQ /update {distrib.from=http://127.0.0.1:40546/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 12092 T982 C102 P40546 REQ /update {distrib.from=http://127.0.0.1:33040/solr/collection1/&update.distrib=TOLEAD

[...truncated too long message...]

t org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
[junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:597)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:662)
[junit4:junit4]   2> 569097 T3392 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> NOTE: test params are: codec=Asserting, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=el_GR, timezone=Etc/GMT+6
[junit4:junit4]   2> NOTE: Linux 3.2.0-34-generic i386/Sun Microsystems Inc. 1.6.0_37 (32-bit)/cpus=8,threads=2,free=355965656,total=496070656
[junit4:junit4]   2> NOTE: All tests run in this JVM: [TestFastWriter, WordBreakSolrSpellCheckerTest, SpatialFilterTest, TestConfig, SpellPossibilityIteratorTest, TestLMDirichletSimilarityFactory, SpellCheckCollatorTest, TestExtendedDismaxParser, TestReload, PreAnalyzedFieldTest, TestLMJelinekMercerSimilarityFactory, TestLFUCache, TestFastLRUCache, RequestHandlersTest, DateFieldTest, DirectSolrConnectionTest, SuggesterWFSTTest, TestWordDelimiterFilterFactory, ResourceLoaderTest, TestDefaultSimilarityFactory, TestBadConfig, ZkCLITest, ResponseLogComponentTest, TestRangeQuery, SolrCoreCheckLockOnStartupTest, TestGroupingSearch, TestJmxMonitoredMap, TermsComponentTest, TestPerFieldSimilarity, BadComponentTest, OverseerCollectionProcessorTest, HighlighterConfigTest, TestSolrQueryParser, CSVRequestHandlerTest, JsonLoaderTest, TestAtomicUpdateErrorCases, TestSolrIndexConfig, SolrCmdDistributorTest, DefaultValueUpdateProcessorTest, SimplePostToolTest, SuggesterFSTTest, DistributedSpellCheckComponentTest, AutoCommitTest, TestJoin, TestQueryTypes, FastVectorHighlighterTest, SearchHandlerTest, UpdateRequestProcessorFactoryTest, TestPHPSerializedResponseWriter, ScriptEngineTest, SortByFunctionTest, AlternateDirectoryTest, LeaderElectionIntegrationTest, CircularListTest, MinimalSchemaTest, TestRandomFaceting, BasicDistributedZkTest, RecoveryZkTest, SpellCheckComponentTest, TestReplicationHandler, LeaderElectionTest, ZkControllerTest, TestDistributedGrouping, TestDistributedSearch, BasicZkTest, ZkSolrClientTest, TestFaceting, DistributedTermsComponentTest, StatsComponentTest, TestRecovery, SolrCoreTest, IndexBasedSpellCheckerTest, DirectUpdateHandlerTest, TestMultiCoreConfBootstrap, SimpleFacetsTest, TestCoreContainer, TestSort, TestFiltering, FileBasedSpellCheckerTest, ConvertedLegacyTest, QueryElevationComponentTest, BasicFunctionalityTest, SignatureUpdateProcessorFactoryTest, TestBinaryResponseWriter, SampleTest, HighlighterTest, TestIndexSearcher, CoreAdminHandlerTest, TestFunctionQuery, SolrRequestParserTest, CacheHeaderTest, QueryEqualityTest, MoreLikeThisHandlerTest, DocumentBuilderTest, MBeansHandlerTest, DistributedQueryElevationComponentTest, CurrencyFieldTest, TestPseudoReturnFields, DisMaxRequestHandlerTest, IndexSchemaTest, BinaryUpdateRequestHandlerTest, QueryParsingTest, DistanceFunctionTest, SolrInfoMBeanTest, XsltUpdateRequestHandlerTest, XmlUpdateRequestHandlerTest, FieldAnalysisRequestHandlerTest, PingRequestHandlerTest, TermVectorComponentTest, DocumentAnalysisRequestHandlerTest, DirectUpdateHandlerOptimizeTest, SolrPluginUtilsTest, TestValueSourceCache, TestReversedWildcardFilterFactory, DebugComponentTest, JSONWriterTest, TestOmitPositions, CopyFieldTest, TestQueryUtils, LoggingHandlerTest, SuggesterTSTTest, UniqFieldsUpdateProcessorFactoryTest, ShowFileRequestHandlerTest, TestSearchPerf, NotRequiredUniqueKeyTest, TestLuceneMatchVersion, TestPropInject, TestWriterPerf, TestIndexingPerformance, NoCacheHeaderTest, FieldMutatingUpdateProcessorTest, TestUpdate, SOLR749Test, TestPropInjectDefaults, TestMergePolicyConfig, TestXIncludeConfig, TestDocSet, TestCollationField, TestQuerySenderNoQuery, NumericFieldsTest, OutputWriterTest, TestNumberUtils, MultiTermTest, TestPhraseSuggestions, LegacyHTMLStripCharFilterTest, TestIBSimilarityFactory, DateMathParserTest, PluginInfoTest, OpenExchangeRatesOrgProviderTest, TestSystemIdResolver, TestSuggestSpellingConverter, DOMUtilTest, RAMDirectoryFactoryTest, SystemInfoHandlerTest, AnalysisAfterCoreReloadTest, TestDocumentBuilder, TestCharFilters, BasicDistributedZk2Test]
[junit4:junit4] Completed on J0 in 569.12s, 1 test, 1 failure <<< FAILURES!

[...truncated 12 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:352: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:178: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:438: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1171: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:835: There were test failures: 239 suites, 994 tests, 1 error, 2 failures, 7 ignored (2 assumptions)

Total time: 40 minutes 25 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 32bit/jdk1.6.0_37 -client -XX:+UseSerialGC
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-4.x-Linux (64bit/jdk1.6.0_37) - Build # 3173 - Still Failing!

Posted by Policeman Jenkins Server <je...@sd-datasolutions.de>.
Build: http://jenkins.sd-datasolutions.de/job/Lucene-Solr-4.x-Linux/3173/
Java: 64bit/jdk1.6.0_37 -XX:+UseConcMarkSweepGC

2 tests failed.
FAILED:  org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch

Error Message:
There are still nodes recoverying - waited for 540 seconds

Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 540 seconds
	at __randomizedtesting.SeedInfo.seed([1598D2695BA3CD59:947E5C712CFCAD65]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:165)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:115)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:110)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:563)
	at org.apache.solr.cloud.BasicDistributedZk2Test.brindDownShardIndexSomeDocsAndRecover(BasicDistributedZk2Test.java:321)
	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:83)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:662)


FAILED:  org.apache.solr.cloud.BasicDistributedZkTest.testDistribSearch

Error Message:
Server at http://127.0.0.1:59636/solr returned non ok status:500, message:Server Error

Stack Trace:
org.apache.solr.common.SolrException: Server at http://127.0.0.1:59636/solr returned non ok status:500, message:Server Error
	at __randomizedtesting.SeedInfo.seed([1598D2695BA3CD59:947E5C712CFCAD65]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:372)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
	at org.apache.solr.client.solrj.request.CoreAdminRequest.process(CoreAdminRequest.java:429)
	at org.apache.solr.client.solrj.request.CoreAdminRequest.getStatus(CoreAdminRequest.java:472)
	at org.apache.solr.cloud.BasicDistributedZkTest.collectStartTimes(BasicDistributedZkTest.java:959)
	at org.apache.solr.cloud.BasicDistributedZkTest.testCollectionsAPI(BasicDistributedZkTest.java:795)
	at org.apache.solr.cloud.BasicDistributedZkTest.doTest(BasicDistributedZkTest.java:343)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:662)




Build Log:
[...truncated 7927 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZkTest
[junit4:junit4]   2> 4 T291 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZkTest-1355274833705
[junit4:junit4]   2> 7 T291 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 9 T292 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 31 T292 oaz.Environment.logEnv Server environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
[junit4:junit4]   2> 32 T292 oaz.Environment.logEnv Server environment:host.name=serv1
[junit4:junit4]   2> 32 T292 oaz.Environment.logEnv Server environment:java.version=1.6.0_37
[junit4:junit4]   2> 32 T292 oaz.Environment.logEnv Server environment:java.vendor=Sun Microsystems Inc.
[junit4:junit4]   2> 32 T292 oaz.Environment.logEnv Server environment:java.home=/mnt/ssd/jenkins/tools/java/64bit/jdk1.6.0_37/jre
[junit4:junit4]   2> 32 T292 oaz.Environment.logEnv Server environment:java.class.path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/test:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/codecs/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-solrj/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/common/lucene-analyzers-common-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/highlighter/lucene-highlighter-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/memory/lucene-memory-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/misc/lucene-misc-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/spatial/lucene-spatial-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/suggest/lucene-suggest-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/grouping/lucene-grouping-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queries/lucene-queries-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queryparser/lucene-queryparser-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/cglib-nodep-2.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-cli-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-codec-1.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-fileupload-1.2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-lang-2.6.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/easymock-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/guava-13.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/javax.servlet-api-3.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/metrics-core-2.1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/objenesis-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/spatial4j-0.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/commons-io-2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpclient-4.1.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpcore-4.1.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpmime-4.1.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/jcl-over-slf4j-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/log4j-over-slf4j-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-api-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-jdk14-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/wstx-asl-3.2.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/zookeeper-3.4.5.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-continuation-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-deploy-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-http-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-io-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-jmx-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-security-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-server-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-servlet-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-util-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-webapp-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-xml-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/servlet-api-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/hsqldb-1.8.0.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/junit-4.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/randomizedtesting-runner-2.0.5.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-launcher.jar:/var/lib/jenkins/.ant/lib/ivy-2.2.0.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jdepend.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-netrexx.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-antlr.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-commons-net.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-javamail.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-regexp.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jsch.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-xalan2.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-junit4.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jmf.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-junit.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-bcel.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jai.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-commons-logging.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-resolver.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-oro.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-swing.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-bsf.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-log4j.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-testutil.jar:/mnt/ssd/jenkins/tools/java/64bit/jdk1.6.0_37/lib/tools.jar:/var/lib/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.0.5.jar
[junit4:junit4]   2> 33 T292 oaz.Environment.logEnv Server environment:java.library.path=/mnt/ssd/jenkins/tools/java/64bit/jdk1.6.0_37/jre/lib/amd64/server:/mnt/ssd/jenkins/tools/java/64bit/jdk1.6.0_37/jre/lib/amd64:/mnt/ssd/jenkins/tools/java/64bit/jdk1.6.0_37/jre/../lib/amd64:/usr/lib/jvm/j2sdk1.6-sun/jre/lib/amd64/server:/usr/lib/jvm/j2sdk1.6-sun/jre/lib/amd64:/usr/lib/jvm/j2sdk1.6-sun/jre/../lib/amd64:/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
[junit4:junit4]   2> 33 T292 oaz.Environment.logEnv Server environment:java.io.tmpdir=.
[junit4:junit4]   2> 33 T292 oaz.Environment.logEnv Server environment:java.compiler=<NA>
[junit4:junit4]   2> 33 T292 oaz.Environment.logEnv Server environment:os.name=Linux
[junit4:junit4]   2> 33 T292 oaz.Environment.logEnv Server environment:os.arch=amd64
[junit4:junit4]   2> 33 T292 oaz.Environment.logEnv Server environment:os.version=3.2.0-34-generic
[junit4:junit4]   2> 34 T292 oaz.Environment.logEnv Server environment:user.name=jenkins
[junit4:junit4]   2> 34 T292 oaz.Environment.logEnv Server environment:user.home=/var/lib/jenkins
[junit4:junit4]   2> 34 T292 oaz.Environment.logEnv Server environment:user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 47 T292 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 48 T292 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4]   2> 48 T292 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4]   2> 58 T292 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 80 T292 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355274833705/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4]   2> 109 T291 oasc.ZkTestServer.run start zk server on port:33954
[junit4:junit4]   2> 136 T291 oaz.Environment.logEnv Client environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
[junit4:junit4]   2> 136 T291 oaz.Environment.logEnv Client environment:host.name=serv1
[junit4:junit4]   2> 137 T291 oaz.Environment.logEnv Client environment:java.version=1.6.0_37
[junit4:junit4]   2> 137 T291 oaz.Environment.logEnv Client environment:java.vendor=Sun Microsystems Inc.
[junit4:junit4]   2> 137 T291 oaz.Environment.logEnv Client environment:java.home=/mnt/ssd/jenkins/tools/java/64bit/jdk1.6.0_37/jre
[junit4:junit4]   2> 138 T291 oaz.Environment.logEnv Client environment:java.class.path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/test:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/codecs/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-solrj/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/common/lucene-analyzers-common-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/highlighter/lucene-highlighter-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/memory/lucene-memory-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/misc/lucene-misc-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/spatial/lucene-spatial-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/suggest/lucene-suggest-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/grouping/lucene-grouping-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queries/lucene-queries-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queryparser/lucene-queryparser-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/cglib-nodep-2.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-cli-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-codec-1.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-fileupload-1.2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-lang-2.6.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/easymock-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/guava-13.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/javax.servlet-api-3.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/metrics-core-2.1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/objenesis-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/spatial4j-0.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/commons-io-2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpclient-4.1.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpcore-4.1.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpmime-4.1.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/jcl-over-slf4j-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/log4j-over-slf4j-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-api-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-jdk14-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/wstx-asl-3.2.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/zookeeper-3.4.5.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-continuation-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-deploy-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-http-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-io-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-jmx-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-security-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-server-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-servlet-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-util-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-webapp-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-xml-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/servlet-api-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/hsqldb-1.8.0.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/junit-4.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/randomizedtesting-runner-2.0.5.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-launcher.jar:/var/lib/jenkins/.ant/lib/ivy-2.2.0.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jdepend.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-netrexx.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-antlr.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-commons-net.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-javamail.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-regexp.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jsch.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-xalan2.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-junit4.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jmf.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-junit.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-bcel.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jai.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-commons-logging.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-resolver.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-oro.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-swing.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-bsf.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-log4j.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-testutil.jar:/mnt/ssd/jenkins/tools/java/64bit/jdk1.6.0_37/lib/tools.jar:/var/lib/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.0.5.jar
[junit4:junit4]   2> 139 T291 oaz.Environment.logEnv Client environment:java.library.path=/mnt/ssd/jenkins/tools/java/64bit/jdk1.6.0_37/jre/lib/amd64/server:/mnt/ssd/jenkins/tools/java/64bit/jdk1.6.0_37/jre/lib/amd64:/mnt/ssd/jenkins/tools/java/64bit/jdk1.6.0_37/jre/../lib/amd64:/usr/lib/jvm/j2sdk1.6-sun/jre/lib/amd64/server:/usr/lib/jvm/j2sdk1.6-sun/jre/lib/amd64:/usr/lib/jvm/j2sdk1.6-sun/jre/../lib/amd64:/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
[junit4:junit4]   2> 139 T291 oaz.Environment.logEnv Client environment:java.io.tmpdir=.
[junit4:junit4]   2> 139 T291 oaz.Environment.logEnv Client environment:java.compiler=<NA>
[junit4:junit4]   2> 140 T291 oaz.Environment.logEnv Client environment:os.name=Linux
[junit4:junit4]   2> 140 T291 oaz.Environment.logEnv Client environment:os.arch=amd64
[junit4:junit4]   2> 140 T291 oaz.Environment.logEnv Client environment:os.version=3.2.0-34-generic
[junit4:junit4]   2> 141 T291 oaz.Environment.logEnv Client environment:user.name=jenkins
[junit4:junit4]   2> 141 T291 oaz.Environment.logEnv Client environment:user.home=/var/lib/jenkins
[junit4:junit4]   2> 141 T291 oaz.Environment.logEnv Client environment:user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 143 T291 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33954 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@4c3ba54b
[junit4:junit4]   2> 162 T291 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 165 T297 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33954. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 168 T297 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33954, initiating session
[junit4:junit4]   2> 190 T293 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50434
[junit4:junit4]   2> 197 T293 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50434
[junit4:junit4]   2> 201 T295 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 277 T295 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8caccf7d0000 with negotiated timeout 10000 for client /127.0.0.1:50434
[junit4:junit4]   2> 277 T297 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33954, sessionid = 0x13b8caccf7d0000, negotiated timeout = 10000
[junit4:junit4]   2> 280 T298 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4c3ba54b name:ZooKeeperConnection Watcher:127.0.0.1:33954 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 280 T291 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 281 T291 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 304 T296 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8caccf7d0000
[junit4:junit4]   2> 305 T298 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 305 T291 oaz.ZooKeeper.close Session: 0x13b8caccf7d0000 closed
[junit4:junit4]   2> 306 T293 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50434 which had sessionid 0x13b8caccf7d0000
[junit4:junit4]   2> 306 T291 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33954/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@7fb22024
[junit4:junit4]   2> 307 T291 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 307 T299 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33954. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 307 T299 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33954, initiating session
[junit4:junit4]   2> 308 T293 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50435
[junit4:junit4]   2> 308 T293 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50435
[junit4:junit4]   2> 308 T295 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8caccf7d0001 with negotiated timeout 10000 for client /127.0.0.1:50435
[junit4:junit4]   2> 309 T299 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33954, sessionid = 0x13b8caccf7d0001, negotiated timeout = 10000
[junit4:junit4]   2> 309 T300 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7fb22024 name:ZooKeeperConnection Watcher:127.0.0.1:33954/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 309 T291 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 311 T291 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 315 T291 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 317 T291 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 320 T291 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 323 T291 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 323 T291 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 339 T291 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 340 T291 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 343 T291 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 344 T291 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 350 T291 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 351 T291 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 354 T291 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 354 T291 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 357 T291 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 357 T291 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 360 T291 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 361 T291 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 364 T291 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 364 T291 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 367 T291 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 368 T291 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 371 T291 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 371 T291 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 374 T296 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8caccf7d0001
[junit4:junit4]   2> 375 T293 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50435 which had sessionid 0x13b8caccf7d0001
[junit4:junit4]   2> 375 T291 oaz.ZooKeeper.close Session: 0x13b8caccf7d0001 closed
[junit4:junit4]   2> 375 T300 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 543 T291 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 626 T291 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:51856
[junit4:junit4]   2> 638 T291 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 638 T291 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355274834076
[junit4:junit4]   2> 639 T291 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355274834076/'
[junit4:junit4]   2> 660 T291 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 661 T291 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 662 T291 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355274834076
[junit4:junit4]   2> 662 T291 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355274834076/solr.xml
[junit4:junit4]   2> 663 T291 oasc.CoreContainer.<init> New CoreContainer 439434773
[junit4:junit4]   2> 664 T291 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355274834076/'
[junit4:junit4]   2> 664 T291 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355274834076/'
[junit4:junit4]   2> 699 T291 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 722 T291 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:33954/solr
[junit4:junit4]   2> 735 T291 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 735 T291 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33954 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@361d148a
[junit4:junit4]   2> 736 T291 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 738 T311 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33954. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 739 T311 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33954, initiating session
[junit4:junit4]   2> 739 T293 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50436
[junit4:junit4]   2> 739 T293 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50436
[junit4:junit4]   2> 741 T295 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8caccf7d0002 with negotiated timeout 20000 for client /127.0.0.1:50436
[junit4:junit4]   2> 741 T311 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33954, sessionid = 0x13b8caccf7d0002, negotiated timeout = 20000
[junit4:junit4]   2> 742 T312 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@361d148a name:ZooKeeperConnection Watcher:127.0.0.1:33954 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 742 T291 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 744 T296 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8caccf7d0002
[junit4:junit4]   2> 744 T312 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 745 T293 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50436 which had sessionid 0x13b8caccf7d0002
[junit4:junit4]   2> 744 T291 oaz.ZooKeeper.close Session: 0x13b8caccf7d0002 closed
[junit4:junit4]   2> 747 T291 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33954/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@44900fd3
[junit4:junit4]   2> 748 T291 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 748 T313 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33954. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 749 T313 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33954, initiating session
[junit4:junit4]   2> 749 T293 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50437
[junit4:junit4]   2> 750 T293 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50437
[junit4:junit4]   2> 751 T295 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8caccf7d0003 with negotiated timeout 8000 for client /127.0.0.1:50437
[junit4:junit4]   2> 751 T313 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33954, sessionid = 0x13b8caccf7d0003, negotiated timeout = 8000
[junit4:junit4]   2> 751 T314 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@44900fd3 name:ZooKeeperConnection Watcher:127.0.0.1:33954/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 752 T291 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 759 T296 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8caccf7d0003 type:create cxid:0x2 zxid:0x1b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 763 T291 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 765 T291 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51856_solr
[junit4:junit4]   2> 768 T296 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8caccf7d0003 type:delete cxid:0x7 zxid:0x1d txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:51856_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:51856_solr
[junit4:junit4]   2> 769 T291 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51856_solr
[junit4:junit4]   2> 772 T291 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 773 T291 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 774 T291 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 775 T291 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 776 T291 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 777 T291 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 777 T291 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 778 T291 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 779 T291 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 780 T291 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 786 T291 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 798 T296 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8caccf7d0003 type:delete cxid:0x15 zxid:0x22 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 799 T291 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 802 T291 oasc.Overseer.start Overseer (id=88819291507195907-127.0.0.1:51856_solr-n_0000000000) starting
[junit4:junit4]   2> 803 T296 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8caccf7d0003 type:create cxid:0x1a zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 809 T296 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8caccf7d0003 type:create cxid:0x1b zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 812 T296 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8caccf7d0003 type:create cxid:0x1c zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 815 T296 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8caccf7d0003 type:create cxid:0x1d zxid:0x27 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 816 T316 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
[junit4:junit4]   2> 817 T291 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 820 T291 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 831 T315 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 847 T317 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355274834076/collection1
[junit4:junit4]   2> 847 T317 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4]   2> 848 T317 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 848 T317 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4]   2> 850 T317 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355274834076/collection1/'
[junit4:junit4]   2> 851 T317 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355274834076/collection1/lib/README' to classloader
[junit4:junit4]   2> 851 T317 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355274834076/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 911 T317 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 967 T317 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 971 T317 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 979 T317 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 1360 T317 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 1367 T317 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 1369 T317 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 1394 T317 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1397 T317 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1401 T317 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1402 T317 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1403 T317 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355274834076/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355274833705/control/data/
[junit4:junit4]   2> 1404 T317 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@9e1be92
[junit4:junit4]   2> 1415 T317 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355274833705/control/data/index/
[junit4:junit4]   2> 1416 T317 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355274833705/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 1417 T317 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355274833705/control/data/index forceNew:false
[junit4:junit4]   2> 1420 T317 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355274833705/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@54193e36; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 1420 T317 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 1421 T317 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 1423 T317 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 1423 T317 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 1423 T317 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 1424 T317 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 1424 T317 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 1425 T317 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 1425 T317 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 1426 T317 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 1426 T317 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 1427 T317 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 1428 T317 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 1429 T317 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 1429 T317 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 1429 T317 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 1430 T317 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 1430 T317 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 1431 T317 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1432 T317 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1432 T317 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1433 T317 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1434 T317 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1435 T317 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1435 T317 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1436 T317 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 1437 T317 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 1439 T317 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 1441 T317 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 1442 T317 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 1445 T317 oass.SolrIndexSearcher.<init> Opening Searcher@249ca61f main
[junit4:junit4]   2> 1445 T317 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 1446 T317 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 1446 T317 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 1446 T317 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 1451 T317 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 1481 T318 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@249ca61f main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 1488 T317 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 1488 T317 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 1489 T296 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8caccf7d0003 type:create cxid:0x53 zxid:0x2a txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 1492 T317 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 1492 T317 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:51856/solr shardId:control_shard
[junit4:junit4]   2> 1498 T317 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4]   2> 1504 T317 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/control_shard/election
[junit4:junit4]   2> 1512 T296 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8caccf7d0003 type:delete cxid:0x62 zxid:0x31 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4]   2> 1513 T317 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 1513 T296 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8caccf7d0003 type:create cxid:0x63 zxid:0x32 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1838 T315 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 1839 T315 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":"control_shard",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:51856_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:51856/solr"}
[junit4:junit4]   2> 1843 T296 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8caccf7d0003 type:create cxid:0x6a zxid:0x34 txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 1854 T314 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 2016 T317 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 2017 T317 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 2017 T317 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:51856/solr/collection1/
[junit4:junit4]   2> 2017 T317 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 2018 T317 oasc.SyncStrategy.syncToMe http://127.0.0.1:51856/solr/collection1/ has no replicas
[junit4:junit4]   2> 2018 T317 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:51856/solr/collection1/
[junit4:junit4]   2> 2019 T317 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/control_shard
[junit4:junit4]   2> 2024 T296 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8caccf7d0003 type:create cxid:0x89 zxid:0x3f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2362 T315 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2369 T314 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 2377 T317 oasc.ZkController.register We are http://127.0.0.1:51856/solr/collection1/ and leader is http://127.0.0.1:51856/solr/collection1/
[junit4:junit4]   2> 2377 T317 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51856/solr
[junit4:junit4]   2> 2377 T317 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 2378 T317 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 2378 T317 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 2380 T317 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2381 T291 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 2382 T291 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 2397 T291 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 2452 T291 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 2454 T291 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:59058
[junit4:junit4]   2> 2455 T291 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 2455 T291 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355274836102
[junit4:junit4]   2> 2456 T291 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355274836102/'
[junit4:junit4]   2> 2471 T291 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 2472 T291 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 2472 T291 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355274836102
[junit4:junit4]   2> 2472 T291 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355274836102/solr.xml
[junit4:junit4]   2> 2473 T291 oasc.CoreContainer.<init> New CoreContainer 64535245
[junit4:junit4]   2> 2473 T291 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355274836102/'
[junit4:junit4]   2> 2474 T291 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355274836102/'
[junit4:junit4]   2> 2486 T291 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 2495 T291 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:33954/solr
[junit4:junit4]   2> 2495 T291 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 2496 T291 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33954 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@3139d474
[junit4:junit4]   2> 2497 T291 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2497 T328 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33954. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 2498 T328 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33954, initiating session
[junit4:junit4]   2> 2498 T293 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50439
[junit4:junit4]   2> 2498 T293 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50439
[junit4:junit4]   2> 2499 T295 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8caccf7d0004 with negotiated timeout 20000 for client /127.0.0.1:50439
[junit4:junit4]   2> 2499 T328 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33954, sessionid = 0x13b8caccf7d0004, negotiated timeout = 20000
[junit4:junit4]   2> 2500 T329 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3139d474 name:ZooKeeperConnection Watcher:127.0.0.1:33954 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2500 T291 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2501 T296 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8caccf7d0004
[junit4:junit4]   2> 2502 T293 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50439 which had sessionid 0x13b8caccf7d0004
[junit4:junit4]   2> 2502 T329 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 2502 T291 oaz.ZooKeeper.close Session: 0x13b8caccf7d0004 closed
[junit4:junit4]   2> 2503 T291 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33954/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@5b9c0686
[junit4:junit4]   2> 2504 T330 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33954. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 2503 T291 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2504 T330 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33954, initiating session
[junit4:junit4]   2> 2504 T293 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50440
[junit4:junit4]   2> 2504 T293 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50440
[junit4:junit4]   2> 2505 T295 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8caccf7d0005 with negotiated timeout 8000 for client /127.0.0.1:50440
[junit4:junit4]   2> 2505 T330 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33954, sessionid = 0x13b8caccf7d0005, negotiated timeout = 8000
[junit4:junit4]   2> 2505 T331 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5b9c0686 name:ZooKeeperConnection Watcher:127.0.0.1:33954/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2505 T291 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2506 T296 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8caccf7d0005 type:create cxid:0x1 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2507 T296 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8caccf7d0005 type:create cxid:0x2 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2508 T291 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59058_solr
[junit4:junit4]   2> 2509 T296 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8caccf7d0005 type:delete cxid:0x4 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:59058_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:59058_solr
[junit4:junit4]   2> 2510 T291 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59058_solr
[junit4:junit4]   2> 2512 T314 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 2513 T314 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 2513 T291 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 2513 T291 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 2514 T291 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 2514 T291 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 2514 T291 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 2515 T291 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 2515 T291 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 2516 T291 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 2516 T291 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 2516 T291 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 2524 T291 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 2531 T332 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355274836102/collection1
[junit4:junit4]   2> 2531 T332 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 2532 T332 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 2532 T332 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 2533 T332 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355274836102/collection1/'
[junit4:junit4]   2> 2534 T332 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty1-1355274836102/collection1/lib/README' to classloader
[junit4:junit4]   2> 2534 T332 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty1-1355274836102/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 2567 T332 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 2608 T332 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 2609 T332 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 2627 T332 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 2876 T315 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2877 T315 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":"control_shard",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:51856_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:51856/solr"}
[junit4:junit4]   2> 2883 T314 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 2883 T331 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 2975 T332 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 2982 T332 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 2985 T332 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 3002 T332 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 3008 T332 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 3011 T332 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 3013 T332 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 3014 T332 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355274836102/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355274833705/jetty1/
[junit4:junit4]   2> 3015 T332 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@9e1be92
[junit4:junit4]   2> 3015 T332 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355274833705/jetty1/index/
[junit4:junit4]   2> 3016 T332 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355274833705/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 3016 T332 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355274833705/jetty1/index forceNew:false
[junit4:junit4]   2> 3019 T332 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355274833705/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@27cca0e; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 3020 T332 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 3020 T332 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 3022 T332 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 3022 T332 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 3022 T332 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 3023 T332 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 3023 T332 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 3023 T332 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 3024 T332 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 3026 T332 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 3027 T332 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 3028 T332 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 3029 T332 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 3029 T332 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 3030 T332 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 3030 T332 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 3030 T332 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 3031 T332 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 3031 T332 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3032 T332 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3033 T332 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3034 T332 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3034 T332 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3035 T332 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3036 T332 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3036 T332 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 3037 T332 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 3039 T332 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 3040 T332 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 3042 T332 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 3044 T332 oass.SolrIndexSearcher.<init> Opening Searcher@6fa5e64c main
[junit4:junit4]   2> 3044 T332 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 3045 T332 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 3045 T332 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 3045 T332 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 3049 T332 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 3073 T333 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6fa5e64c main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 3078 T332 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 3078 T332 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 3388 T315 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3389 T315 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:59058_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:59058/solr"}
[junit4:junit4]   2> 3389 T315 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4]   2> 3391 T315 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 3396 T314 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3396 T331 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3580 T332 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 3580 T332 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:59058/solr shardId:shard1
[junit4:junit4]   2> 3581 T332 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 3590 T296 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8caccf7d0005 type:delete cxid:0x45 zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 3590 T332 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 3591 T296 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8caccf7d0005 type:create cxid:0x46 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3592 T332 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 3593 T332 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 3593 T332 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:59058/solr/collection1/
[junit4:junit4]   2> 3593 T332 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 3593 T332 oasc.SyncStrategy.syncToMe http://127.0.0.1:59058/solr/collection1/ has no replicas
[junit4:junit4]   2> 3594 T332 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:59058/solr/collection1/
[junit4:junit4]   2> 3594 T332 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 3598 T296 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8caccf7d0005 type:create cxid:0x50 zxid:0x60 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3901 T315 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3911 T314 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3911 T331 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3950 T332 oasc.ZkController.register We are http://127.0.0.1:59058/solr/collection1/ and leader is http://127.0.0.1:59058/solr/collection1/
[junit4:junit4]   2> 3950 T332 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:59058/solr
[junit4:junit4]   2> 3950 T332 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 3951 T332 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 3951 T332 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 3953 T332 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3954 T291 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 3954 T291 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 3955 T291 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 4007 T291 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 4009 T291 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:43474
[junit4:junit4]   2> 4010 T291 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 4011 T291 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355274837658
[junit4:junit4]   2> 4011 T291 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355274837658/'
[junit4:junit4]   2> 4026 T291 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 4027 T291 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 4027 T291 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355274837658
[junit4:junit4]   2> 4027 T291 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355274837658/solr.xml
[junit4:junit4]   2> 4028 T291 oasc.CoreContainer.<init> New CoreContainer 1828333408
[junit4:junit4]   2> 4028 T291 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355274837658/'
[junit4:junit4]   2> 4029 T291 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355274837658/'
[junit4:junit4]   2> 4041 T291 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 4049 T291 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:33954/solr
[junit4:junit4]   2> 4050 T291 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 4050 T291 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33954 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@3d007ab4
[junit4:junit4]   2> 4051 T343 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33954. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 4051 T291 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4052 T343 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33954, initiating session
[junit4:junit4]   2> 4052 T293 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50441
[junit4:junit4]   2> 4052 T293 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50441
[junit4:junit4]   2> 4053 T295 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8caccf7d0006 with negotiated timeout 20000 for client /127.0.0.1:50441
[junit4:junit4]   2> 4053 T343 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33954, sessionid = 0x13b8caccf7d0006, negotiated timeout = 20000
[junit4:junit4]   2> 4054 T344 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3d007ab4 name:ZooKeeperConnection Watcher:127.0.0.1:33954 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4054 T291 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4055 T296 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8caccf7d0006
[junit4:junit4]   2> 4056 T344 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 4056 T293 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50441 which had sessionid 0x13b8caccf7d0006
[junit4:junit4]   2> 4056 T291 oaz.ZooKeeper.close Session: 0x13b8caccf7d0006 closed
[junit4:junit4]   2> 4056 T291 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33954/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@32f8833d
[junit4:junit4]   2> 4057 T345 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33954. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 4057 T291 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4058 T345 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33954, initiating session
[junit4:junit4]   2> 4058 T293 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50442
[junit4:junit4]   2> 4058 T293 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50442
[junit4:junit4]   2> 4059 T295 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8caccf7d0007 with negotiated timeout 8000 for client /127.0.0.1:50442
[junit4:junit4]   2> 4059 T345 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33954, sessionid = 0x13b8caccf7d0007, negotiated timeout = 8000
[junit4:junit4]   2> 4059 T346 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@32f8833d name:ZooKeeperConnection Watcher:127.0.0.1:33954/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4059 T291 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4060 T296 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8caccf7d0007 type:create cxid:0x1 zxid:0x6d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4061 T296 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8caccf7d0007 type:create cxid:0x2 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4062 T291 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43474_solr
[junit4:junit4]   2> 4063 T296 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8caccf7d0007 type:delete cxid:0x4 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:43474_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:43474_solr
[junit4:junit4]   2> 4063 T291 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:43474_solr
[junit4:junit4]   2> 4066 T314 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 4066 T331 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 4066 T314 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4066 T331 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4067 T291 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 4067 T291 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 4068 T291 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 4068 T291 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 4069 T291 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 4069 T291 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 4069 T291 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 4070 T291 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 4070 T291 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 4071 T291 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 4077 T291 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 4083 T347 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355274837658/collection1
[junit4:junit4]   2> 4083 T347 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 4084 T347 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 4084 T347 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 4085 T347 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355274837658/collection1/'
[junit4:junit4]   2> 4086 T347 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty2-1355274837658/collection1/lib/README' to classloader
[junit4:junit4]   2> 4086 T347 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty2-1355274837658/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 4128 T347 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 4169 T347 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 4171 T347 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 4178 T347 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 4419 T315 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4420 T315 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:59058_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:59058/solr"}
[junit4:junit4]   2> 4424 T314 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4424 T331 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4424 T346 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4546 T347 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 4552 T347 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 4555 T347 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 4570 T347 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 4574 T347 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 4577 T347 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 4578 T347 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 4579 T347 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355274837658/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355274833705/jetty2/
[junit4:junit4]   2> 4579 T347 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@9e1be92
[junit4:junit4]   2> 4580 T347 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355274833705/jetty2/index/
[junit4:junit4]   2> 4580 T347 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355274833705/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 4581 T347 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355274833705/jetty2/index forceNew:false
[junit4:junit4]   2> 4584 T347 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355274833705/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6a6814fc; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 4585 T347 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 4585 T347 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 4587 T347 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 4587 T347 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 4587 T347 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 4587 T347 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 4588 T347 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 4588 T347 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 4588 T347 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 4589 T347 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 4590 T347 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 4592 T347 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 4593 T347 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 4594 T347 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 4594 T347 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 4594 T347 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 4595 T347 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 4595 T347 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 4596 T347 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4597 T347 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4597 T347 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4598 T347 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4599 T347 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4600 T347 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4600 T347 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4601 T347 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 4602 T347 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 4603 T347 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 4605 T347 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 4607 T347 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 4609 T347 oass.SolrIndexSearcher.<init> Opening Searcher@6fc8e2e7 main
[junit4:junit4]   2> 4609 T347 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 4610 T347 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 4610 T347 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 4610 T347 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 4614 T347 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 4638 T348 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6fc8e2e7 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 4643 T347 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 4643 T347 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 4930 T315 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4931 T315 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:43474_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:43474/solr"}
[junit4:junit4]   2> 4931 T315 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 4931 T315 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4]   2> 4936 T346 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4936 T331 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4936 T314 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5146 T347 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 5146 T347 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:43474/solr shardId:shard2
[junit4:junit4]   2> 5147 T347 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4]   2> 5153 T296 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8caccf7d0007 type:delete cxid:0x44 zxid:0x7e txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard2 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard2
[junit4:junit4]   2> 5153 T347 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 5154 T296 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8caccf7d0007 type:create cxid:0x45 zxid:0x7f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5155 T347 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 5156 T347 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 5156 T347 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:43474/solr/collection1/
[junit4:junit4]   2> 5156 T347 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 5156 T347 oasc.SyncStrategy.syncToMe http://127.0.0.1:43474/solr/collection1/ has no replicas
[junit4:junit4]   2> 5156 T347 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:43474/solr/collection1/
[junit4:junit4]   2> 5156 T347 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4]   2> 5160 T296 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8caccf7d0007 type:create cxid:0x4e zxid:0x82 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5441 T315 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5449 T314 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5449 T331 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5450 T346 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5462 T347 oasc.ZkController.register We are http://127.0.0.1:43474/solr/collection1/ and leader is http://127.0.0.1:43474/solr/collection1/
[junit4:junit4]   2> 5462 T347 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:43474/solr
[junit4:junit4]   2> 5462 T347 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 5462 T347 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 5463 T347 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 5464 T347 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5465 T291 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 5466 T291 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 5467 T291 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 5519 T291 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 5522 T291 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:51704
[junit4:junit4]   2> 5523 T291 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 5523 T291 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355274839170
[junit4:junit4]   2> 5524 T291 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355274839170/'
[junit4:junit4]   2> 5540 T291 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 5540 T291 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 5541 T291 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355274839170
[junit4:junit4]   2> 5541 T291 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355274839170/solr.xml
[junit4:junit4]   2> 5542 T291 oasc.CoreContainer.<init> New CoreContainer 1908604304
[junit4:junit4]   2> 5542 T291 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355274839170/'
[junit4:junit4]   2> 5542 T291 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355274839170/'
[junit4:junit4]   2> 5554 T291 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 5563 T291 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:33954/solr
[junit4:junit4]   2> 5563 T291 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 5564 T291 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33954 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@4b5a1aa4
[junit4:junit4]   2> 5565 T358 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33954. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 5565 T291 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 5566 T358 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33954, initiating session
[junit4:junit4]   2> 5566 T293 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50443
[junit4:junit4]   2> 5566 T293 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50443
[junit4:junit4]   2> 5567 T295 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8caccf7d0008 with negotiated timeout 20000 for client /127.0.0.1:50443
[junit4:junit4]   2> 5567 T358 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33954, sessionid = 0x13b8caccf7d0008, negotiated timeout = 20000
[junit4:junit4]   2> 5567 T359 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4b5a1aa4 name:ZooKeeperConnection Watcher:127.0.0.1:33954 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 5567 T291 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 5569 T296 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8caccf7d0008
[junit4:junit4]   2> 5569 T359 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 5569 T293 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50443 which had sessionid 0x13b8caccf7d0008
[junit4:junit4]   2> 5569 T291 oaz.ZooKeeper.close Session: 0x13b8caccf7d0008 closed
[junit4:junit4]   2> 5570 T291 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33954/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@5f578222
[junit4:junit4]   2> 5571 T360 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33954. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 5571 T291 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 5571 T360 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33954, initiating session
[junit4:junit4]   2> 5571 T293 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50444
[junit4:junit4]   2> 5572 T293 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50444
[junit4:junit4]   2> 5572 T295 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8caccf7d0009 with negotiated timeout 8000 for client /127.0.0.1:50444
[junit4:junit4]   2> 5572 T360 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33954, sessionid = 0x13b8caccf7d0009, negotiated timeout = 8000
[junit4:junit4]   2> 5573 T361 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5f578222 name:ZooKeeperConnection Watcher:127.0.0.1:33954/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 5573 T291 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 5574 T296 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8caccf7d0009 type:create cxid:0x1 zxid:0x8f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5575 T296 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8caccf7d0009 type:create cxid:0x2 zxid:0x90 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5576 T291 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51704_solr
[junit4:junit4]   2> 5577 T296 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8caccf7d0009 type:delete cxid:0x4 zxid:0x91 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:51704_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:51704_solr
[junit4:junit4]   2> 5577 T291 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51704_solr
[junit4:junit4]   2> 5580 T346 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5580 T314 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 5580 T331 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 5580 T314 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5580 T331 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5581 T291 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 5582 T346 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 5582 T291 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 5583 T291 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 5583 T291 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 5583 T291 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 5584 T291 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 5584 T291 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 5585 T291 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 5585 T291 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 5585 T291 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 5592 T291 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 5597 T362 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355274839170/collection1
[junit4:junit4]   2> 5598 T362 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 5598 T362 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 5599 T362 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 5600 T362 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355274839170/collection1/'
[junit4:junit4]   2> 5600 T362 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty3-1355274839170/collection1/lib/README' to classloader
[junit4:junit4]   2> 5601 T362 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty3-1355274839170/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 5639 T362 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 5684 T362 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 5685 T362 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 5692 T362 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 5958 T315 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5959 T315 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:43474_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:43474/solr"}
[junit4:junit4]   2> 5963 T314 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5963 T331 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5963 T346 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 5964 T361 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6072 T362 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 6077 T362 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 6080 T362 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 6096 T362 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 6099 T362 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 6102 T362 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 6104 T362 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 6105 T362 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355274839170/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355274833705/jetty3/
[junit4:junit4]   2> 6105 T362 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@9e1be92
[junit4:junit4]   2> 6106 T362 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355274833705/jetty3/index/
[junit4:junit4]   2> 6106 T362 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355274833705/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 6107 T362 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355274833705/jetty3/index forceNew:false
[junit4:junit4]   2> 6110 T362 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355274833705/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1aecdfce; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 6110 T362 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 6111 T362 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 6112 T362 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 6113 T362 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 6113 T362 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 6113 T362 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 6114 T362 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 6114 T362 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 6114 T362 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 6115 T362 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 6116 T362 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 6116 T362 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 6117 T362 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 6120 T362 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 6120 T362 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 6121 T362 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 6121 T362 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 6121 T362 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 6122 T362 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6123 T362 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6123 T362 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6124 T362 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6125 T362 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6125 T362 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6126 T362 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6127 T362 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 6127 T362 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 6129 T362 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 6131 T362 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 6132 T362 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 6134 T362 oass.SolrIndexSearcher.<init> Opening Searcher@f0c37b4 main
[junit4:junit4]   2> 6134 T362 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 6135 T362 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 6135 T362 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 6136 T362 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 6139 T362 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 6166 T363 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@f0c37b4 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 6172 T362 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 6172 T362 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 6469 T315 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6470 T315 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:51704_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:51704/solr"}
[junit4:junit4]   2> 6471 T315 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 6471 T315 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 6476 T331 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6476 T346 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6476 T314 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6476 T361 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6673 T362 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 6673 T362 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:51704/solr shardId:shard1
[junit4:junit4]   2> 6678 T362 oasc.ZkController.register We are http://127.0.0.1:51704/solr/collection1/ and leader is http://127.0.0.1:59058/solr/collection1/
[junit4:junit4]   2> 6678 T362 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51704/solr
[junit4:junit4]   2> 6678 T362 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 6678 T362 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C21 name=collection1 org.apache.solr.core.SolrCore@43193f30 url=http://127.0.0.1:51704/solr/collection1 node=127.0.0.1:51704_solr
[junit4:junit4]   2> 6681 T364 C21 P51704 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 6681 T362 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6682 T364 C21 P51704 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 6682 T364 C21 P51704 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 6682 T364 C21 P51704 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 6683 T291 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 6683 T364 C21 P51704 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:59058/solr/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 6683 T291 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 6684 T291 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 6686 T364 C21 P51704 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4]   2> 6690 T364 C21 P51704 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:51704/solr START replicas=[http://127.0.0.1:59058/solr/collection1/] nUpdates=100
[junit4:junit4]   2> 6692 T364 C21 P51704 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 6693 T364 C21 P51704 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 6693 T364 C21 P51704 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 6693 T364 C21 P51704 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 6737 T291 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 6740 T291 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:59636
[junit4:junit4]   2> 6741 T291 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 6741 T291 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355274840387
[junit4:junit4]   2> 6746 T291 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355274840387/'
[junit4:junit4]   2> 6780 T291 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 6781 T291 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 6781 T291 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355274840387
[junit4:junit4]   2> 6782 T291 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355274840387/solr.xml
[junit4:junit4]   2> 6782 T291 oasc.CoreContainer.<init> New CoreContainer 1691038692
[junit4:junit4]   2> 6783 T291 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355274840387/'
[junit4:junit4]   2> 6783 T291 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355274840387/'
[junit4:junit4]   2> 6831 T291 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 6848 T291 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:33954/solr
[junit4:junit4]   2> 6849 T291 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 6849 T291 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33954 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@2a59ff94
[junit4:junit4]   2> 6851 T291 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6851 T375 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33954. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 6852 T375 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33954, initiating session
[junit4:junit4]   2> 6852 T293 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50447
[junit4:junit4]   2> 6852 T293 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50447
[junit4:junit4]   2> 6853 T295 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8caccf7d000a with negotiated timeout 20000 for client /127.0.0.1:50447
[junit4:junit4]   2> 6853 T375 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33954, sessionid = 0x13b8caccf7d000a, negotiated timeout = 20000
[junit4:junit4]   2> 6854 T376 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2a59ff94 name:ZooKeeperConnection Watcher:127.0.0.1:33954 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6854 T291 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6855 T296 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8caccf7d000a
[junit4:junit4]   2> 6856 T376 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 6856 T293 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50447 which had sessionid 0x13b8caccf7d000a
[junit4:junit4]   2> 6856 T291 oaz.ZooKeeper.close Session: 0x13b8caccf7d000a closed
[junit4:junit4]   2> 6857 T291 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33954/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@7655c4a3
[junit4:junit4]   2> 6858 T377 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33954. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 6858 T291 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6859 T377 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33954, initiating session
[junit4:junit4]   2> 6859 T293 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50448
[junit4:junit4]   2> 6859 T293 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50448
[junit4:junit4]   2> 6860 T295 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8caccf7d000b with negotiated timeout 8000 for client /127.0.0.1:50448
[junit4:junit4]   2> 6860 T377 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33954, sessionid = 0x13b8caccf7d000b, negotiated timeout = 8000
[junit4:junit4]   2> 6860 T378 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7655c4a3 name:ZooKeeperConnection Watcher:127.0.0.1:33954/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6860 T291 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6862 T296 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8caccf7d000b type:create cxid:0x1 zxid:0xa2 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6863 T296 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8caccf7d000b type:create cxid:0x2 zxid:0xa3 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6864 T291 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59636_solr
[junit4:junit4]   2> 6865 T296 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8caccf7d000b type:delete cxid:0x4 zxid:0xa4 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:59636_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:59636_solr
[junit4:junit4]   2> 6866 T291 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59636_solr
[junit4:junit4]   2> 6868 T346 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6868 T361 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 6869 T314 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 6869 T331 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 6869 T314 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6869 T331 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6871 T361 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 6872 T346 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 6871 T291 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 6872 T291 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 6873 T291 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 6874 T291 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 6874 T291 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 6875 T291 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 6876 T291 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 6876 T291 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 6877 T291 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 6877 T291 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 6886 T291 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 6894 T379 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355274840387/collection1
[junit4:junit4]   2> 6894 T379 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 6895 T379 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 6896 T379 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 6897 T379 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355274840387/collection1/'
[junit4:junit4]   2> 6898 T379 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty4-1355274840387/collection1/lib/README' to classloader
[junit4:junit4]   2> 6898 T379 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty4-1355274840387/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 6986 T315 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6987 T315 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:51704_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:51704/solr"}
[junit4:junit4]   2> 6993 T378 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6993 T346 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6993 T361 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6993 T331 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 6994 T314 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> ASYNC  NEW_CORE C22 name=collection1 org.apache.solr.core.SolrCore@155ce3e6 url=http://127.0.0.1:59058/solr/collection1 node=127.0.0.1:59058_solr
[junit4:junit4]   2> 6995 T324 C22 P59058 REQ /get {distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=6 
[junit4:junit4]   2> 6996 T379 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 7041 T379 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 7046 T379 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 7052 T379 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 7418 T379 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 7428 T379 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 7431 T379 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 7449 T379 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 7453 T379 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 7456 T379 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 7458 T379 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 7459 T379 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355274840387/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355274833705/jetty4/
[junit4:junit4]   2> 7460 T379 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@9e1be92
[junit4:junit4]   2> 7460 T379 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355274833705/jetty4/index/
[junit4:junit4]   2> 7461 T379 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355274833705/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 7461 T379 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355274833705/jetty4/index forceNew:false
[junit4:junit4]   2> 7467 T379 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355274833705/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1c83ef06; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 7468 T379 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 7468 T379 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 7470 T379 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 7470 T379 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 7470 T379 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 7471 T379 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 7471 T379 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 7471 T379 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 7472 T379 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 7472 T379 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 7473 T379 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 7474 T379 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 7475 T379 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 7475 T379 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 7476 T379 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 7476 T379 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 7476 T379 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 7477 T379 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 7478 T379 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7478 T379 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7479 T379 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7480 T379 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7480 T379 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7481 T379 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7482 T379 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7482 T379 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 7483 T379 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 7485 T379 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 7486 T379 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 7488 T379 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 7490 T379 oass.SolrIndexSearcher.<init> Opening Searcher@6d32b04b main
[junit4:junit4]   2> 7490 T379 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 7491 T379 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 7491 T379 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 7492 T379 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 7495 T379 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 7521 T380 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6d32b04b main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 7527 T379 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 7527 T379 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 8002 T315 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8003 T315 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:59636_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:59636/solr"}
[junit4:junit4]   2> 8003 T315 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 8003 T315 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4]   2> 8008 T378 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8008 T331 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8008 T346 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8008 T314 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8008 T361 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8029 T379 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 8029 T379 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:59636/solr shardId:shard2
[junit4:junit4]   2> 8033 T379 oasc.ZkController.register We are http://127.0.0.1:59636/solr/collection1/ and leader is http://127.0.0.1:43474/solr/collection1/
[junit4:junit4]   2> 8033 T379 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:59636/solr
[junit4:junit4]   2> 8033 T379 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 8033 T379 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C23 name=collection1 org.apache.solr.core.SolrCore@6d152d0e url=http://127.0.0.1:59636/solr/collection1 node=127.0.0.1:59636_solr
[junit4:junit4]   2> 8034 T381 C23 P59636 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 8034 T381 C23 P59636 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 8035 T381 C23 P59636 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 8035 T379 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8035 T381 C23 P59636 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 8036 T381 C23 P59636 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:43474/solr/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 8036 T381 C23 P59636 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:59636/solr START replicas=[http://127.0.0.1:43474/solr/collection1/] nUpdates=100
[junit4:junit4]   2> 8036 T291 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 8037 T381 C23 P59636 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 8037 T381 C23 P59636 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 8037 T291 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 8037 T381 C23 P59636 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 8038 T381 C23 P59636 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C24 name=collection1 org.apache.solr.core.SolrCore@42a54c1d url=http://127.0.0.1:43474/solr/collection1 node=127.0.0.1:43474_solr
[junit4:junit4]   2> 8042 T339 C24 P43474 REQ /get {distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=0 
[junit4:junit4]   2> 8038 T291 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 8046 T291 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33954/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@5a8ae265
[junit4:junit4]   2> 8050 T291 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 8053 T383 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33954. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 8053 T383 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33954, initiating session
[junit4:junit4]   2> 8054 T293 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50451
[junit4:junit4]   2> 8054 T293 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50451
[junit4:junit4]   2> 8055 T295 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8caccf7d000c with negotiated timeout 10000 for client /127.0.0.1:50451
[junit4:junit4]   2> 8055 T383 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33954, sessionid = 0x13b8caccf7d000c, negotiated timeout = 10000
[junit4:junit4]   2> 8055 T384 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5a8ae265 name:ZooKeeperConnection Watcher:127.0.0.1:33954/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 8055 T291 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 8056 T291 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 8059 T291 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 8060 T291 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 8064 T291 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8065 T291 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):540
[junit4:junit4]   2> 8066 T291 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8516 T315 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8518 T315 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:59636_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:59636/solr"}
[junit4:junit4]   2> 8523 T378 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8523 T314 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8523 T346 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8523 T361 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8523 T384 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 8523 T331 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9068 T291 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2>  C21_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:51704_solr, base_url=http://127.0.0.1:51704/solr}
[junit4:junit4]   2> 9993 T364 C21 P51704 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 9993 T364 C21 P51704 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 9993 T364 C21 P51704 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:59058/solr/collection1/. core=collection1
[junit4:junit4]   2> 9994 T364 C21 P51704 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 10001 T324 C22 P59058 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16
[junit4:junit4]   2> 10008 T324 C22 P59058 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 10011 T324 C22 P59058 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355274833705/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@27cca0e; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 10012 T324 C22 P59058 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 10018 T324 C22 P59058 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355274833705/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@27cca0e; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355274833705/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@27cca0e; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 10018 T324 C22 P59058 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 10019 T324 C22 P59058 oass.SolrIndexSearcher.<init> Opening Searcher@5acd485a realtime
[junit4:junit4]   2> 10019 T324 C22 P59058 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 10020 T324 C22 P59058 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 10020 T324 C22 P59058 /update {waitSearcher=true&openSearcher=false&commit=true&commit_end_point=true&wt=javabin&softCommit=false&version=2} {commit=} 0 20
[junit4:junit4]   2> 10021 T364 C21 P51704 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 10022 T364 C21 P51704 oascsi.HttpClientUtil.createClient Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
[junit4:junit4]   2> 10026 T364 C21 P51704 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 10040 T326 C22 P59058 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 10041 T326 C22 P59058 REQ /replication {command=indexversion&wt=javabin&qt=/replication&version=2} status=0 QTime=13 
[junit4:junit4]   2> 10042 T364 C21 P51704 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 10042 T364 C21 P51704 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 10042 T364 C21 P51704 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 10045 T325 C22 P59058 REQ /replication {command=filelist&generation=2&wt=javabin&qt=/replication&version=2} status=0 QTime=0 
[junit4:junit4]   2> 10046 T364 C21 P51704 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 10047 T364 C21 P51704 oash.SnapPuller.fetchLatestIndex Starting download to ./org.apache.solr.cloud.BasicDistributedZkTest-1355274833705/jetty3/index.20121211181403746 fullCopy=true
[junit4:junit4]   2> 10052 T324 C22 P59058 REQ /replication {file=segments_2&command=filecontent&checksum=true&generation=2&qt=/replication&wt=filestream} status=0 QTime=1 
[junit4:junit4]   2> 10057 T364 C21 P51704 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 10068 T364 C21 P51704 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20121211181403746
[junit4:junit4]   2> 10070 T364 C21 P51704 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.BasicDistributedZkTest-1355274833705/jetty3/index/ new=./org.apache.solr.cloud.BasicDistributedZkTest-1355274833705/jetty3/index.20121211181403746
[junit4:junit4]   2> 10070 T364 C21 P51704 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355274833705/jetty3/index.20121211181403746 forceNew:false
[junit4:junit4]   2> 10070 T291 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10072 T364 C21 P51704 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355274833705/jetty3/index.20121211181403746 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6a0fa74; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 10072 T364 C21 P51704 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 10074 T364 C21 P51704 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 10074 T364 C21 P51704 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 10074 T364 C21 P51704 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4]   2> 10075 T364 C21 P51704 oasc.CachingDirectoryFactory.close Closing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355274833705/jetty3/index.20121211181403746
[junit4:junit4]   2> 10075 T364 C21 P51704 oash.SnapPuller$2.onClose removing old index directory ./org.apache.solr.cloud.BasicDistributedZkTest-1355274833705/jetty3/index
[junit4:junit4]   2> 10076 T364 C21 P51704 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355274833705/jetty3/index.20121211181403746 forceNew:true
[junit4:junit4]   2> 10077 T364 C21 P51704 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355274833705/jetty3/index.20121211181403746 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7f537f4c; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 10078 T364 C21 P51704 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 10078 T364 C21 P51704 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 10078 T364 C21 P51704 oass.SolrIndexSearcher.<init> Opening Searcher@2b998b0 main
[junit4:junit4]   2> 10078 T364 C21 P51704 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 10080 T363 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2b998b0 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 10080 T364 C21 P51704 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 10110 T364 C21 P51704 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355274833705/jetty3/index.20121211181403746 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7f537f4c; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355274833705/jetty3/index.20121211181403746 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7f537f4c; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 10110 T364 C21 P51704 oasc.SolrDeletionPolicy.updateCommits newest commit = 3
[junit4:junit4]   2> 10111 T364 C21 P51704 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 10111 T364 C21 P51704 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 10111 T364 C21 P51704 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 10111 T364 C21 P51704 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 10111 T364 C21 P51704 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 10112 T364 C21 P51704 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 10535 T315 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10536 T315 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:51704_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:51704/solr"}
[junit4:junit4]   2> 10548 T378 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10548 T346 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10549 T314 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10548 T331 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10548 T384 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 10549 T361 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2>  C23_STATE=coll:collection1 core:collection1 props:{shard=shard2, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:59636_solr, base_url=http://127.0.0.1:59636/solr}
[junit4:junit4]   2> 11054 T381 C23 P59636 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 11054 T381 C23 P59636 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 11055 T381 C23 P59636 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:43474/solr/collection1/. core=collection1
[junit4:junit4]   2> 11055 T381 C23 P59636 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 11060 T340 C24 P43474 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 11062 T340 C24 P43474 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355274833705/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6a6814fc; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 11063 T340 C24 P43474 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 11068 T340 C24 P43474 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355274833705/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6a6814fc; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355274833705/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6a6814fc; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 11069 T340 C24 P43474 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 11069 T340 C24 P43474 oass.SolrIndexSearcher.<init> Opening Searcher@762cce7d realtime
[junit4:junit4]   2> 11069 T340 C24 P43474 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 11070 T340 C24 P43474 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 11070 T340 C24 P43474 /update {waitSearcher=true&openSearcher=false&commit=true&commit_end_point=true&wt=javabin&softCommit=false&version=2} {commit=} 0 10
[junit4:junit4]   2> 11071 T381 C23 P59636 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 11072 T381 C23 P59636 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 11073 T291 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 11074 T342 C24 P43474 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 11075 T342 C24 P43474 REQ /replication {command=indexversion&wt=javabin&qt=/replication&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11075 T381 C23 P59636 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 11075 T381 C23 P59636 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 11076 T381 C23 P59636 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 11078 T339 C24 P43474 REQ /replication {command=filelist&generation=2&wt=javabin&qt=/replication&version=2} status=0 QTime=0 
[junit4:junit4]   2> 11079 T381 C23 P59636 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 11079 T381 C23 P59636 oash.SnapPuller.fetchLatestIndex Starting download to ./org.apache.solr.cloud.BasicDistributedZkTest-1355274833705/jetty4/index.20121211181404779 fullCopy=true
[junit4:junit4]   2> 11081 T340 C24 P43474 REQ /replication {file=segments_2&command=filecontent&checksum=true&generation=2&qt=/replication&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 11083 T381 C23 P59636 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 11088 T381 C23 P59636 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20121211181404779
[junit4:junit4]   2> 11089 T381 C23 P59636 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.BasicDistributedZkTest-1355274833705/jetty4/index/ new=./org.apache.solr.cloud.BasicDistributedZkTest-1355274833705/jetty4/index.20121211181404779
[junit4:junit4]   2> 11090 T381 C23 P59636 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355274833705/jetty4/index.20121211181404779 forceNew:false
[junit4:junit4]   2> 11091 T381 C23 P59636 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355274833705/jetty4/index.20121211181404779 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7aa382a; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 11092 T381 C23 P59636 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 11092 T381 C23 P59636 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 11092 T381 C23 P59636 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 11093 T381 C23 P59636 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4]   2> 11093 T381 C23 P59636 oasc.CachingDirectoryFactory.close Closing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355274833705/jetty4/index.20121211181404779
[junit4:junit4]   2> 11093 T381 C23 P59636 oash.SnapPuller$2.onClose removing old index directory ./org.apache.solr.cloud.BasicDistributedZkTest-1355274833705/jetty4/index
[junit4:junit4]   2> 11094 T381 C23 P59636 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355274833705/jetty4/index.20121211181404779 forceNew:true
[junit4:junit4]   2> 11095 T381 C23 P59636 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355274833705/jetty4/index.20121211181404779 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5b794a2d; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 11096 T381 C23 P59636 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 11096 T381 C23 P59636 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 11096 T381 C23 P59636 oass.SolrIndexSearcher.<init> Opening Searcher@75a34889 main
[junit4:junit4]   2> 11096 T381 C23 P59636 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 11098 T380 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@75a34889 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 11098 T381 C23 P59636 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 11119 T381 C23 P59636 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355274833705/jetty4/index.20121211181404779 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5b794a2d; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355274833705/jetty4/index.20121211181404779 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5b794a2d; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 11120 T381 C23 P59636 oasc.SolrDeletionPolicy.updateCommits newest commit = 3
[junit4:junit4]   2> 11120 T381 C23 P59636 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 11120 T381 C23 P59636 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 11120 T381 C23 P59636 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 11121 T381 C23 P59636 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 11121 T381 C23 P59636 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 11122 T381 C23 P59636 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 11557 T315 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 11558 T315 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:59636_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:59636/solr"}
[junit4:junit4]   2> 11563 T378 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 11563 T384 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 11563 T314 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 11563 T331 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 11564 T346 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 11563 T361 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 12075 T291 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> ASYNC  NEW_CORE C25 name=collection1 org.apache.solr.core.SolrCore@12060bf2 url=http://127.0.0.1:51856/solr/collection1 node=127.0.0.1:51856_solr
[junit4:junit4]   2> 12102 T307 C25 P51856 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355274833705/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@54193e36; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 12103 T307 C25 P51856 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 12105 T307 C25 P51856 oass.SolrIndexSearcher.<init> Opening Searcher@13bc9d03 realtime
[junit4:junit4]   2> 12105 T307 C25 P51856 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
[junit4:junit4]   2> 12105 T307 C25 P51856 /update {wt=javabin&version=2} {deleteByQuery=*:* (-1421108676709580800)} 0 12
[junit4:junit4]   2> 12106 T291 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33954/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@43e83a14
[junit4:junit4]   2> 12107 T291 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 12107 T387 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33954. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 12108 T387 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33954, initiating session
[junit4:junit4]   2> 12108 T293 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50457
[junit4:junit4]   2> 12108 T293 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50457
[junit4:junit4]   2> 12110 T295 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8caccf7d000d with negotiated timeout 10000 for client /127.0.0.1:50457
[junit4:junit4]   2> 12110 T387 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33954, sessionid = 0x13b8caccf7d000d, negotiated timeout = 10000
[junit4:junit4]   2> 12110 T388 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@43e83a14 name:ZooKeeperConnection Watcher:127.0.0.1:33954/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 12111 T291 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 12112 T291 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2>  C21_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=active, core=collection1, collectio

[...truncated too long message...]

    "127.0.0.1:55626_solr_collection1":{
[junit4:junit4]   1>                 "shard":"shard2",
[junit4:junit4]   1>                 "roles":null,
[junit4:junit4]   1>                 "state":"recovering",
[junit4:junit4]   1>                 "core":"collection1",
[junit4:junit4]   1>                 "collection":"collection1",
[junit4:junit4]   1>                 "node_name":"127.0.0.1:55626_solr",
[junit4:junit4]   1>                 "base_url":"http://127.0.0.1:55626/solr"},
[junit4:junit4]   1>               "127.0.0.1:51322_solr_collection1":{
[junit4:junit4]   1>                 "shard":"shard2",
[junit4:junit4]   1>                 "roles":null,
[junit4:junit4]   1>                 "state":"active",
[junit4:junit4]   1>                 "core":"collection1",
[junit4:junit4]   1>                 "collection":"collection1",
[junit4:junit4]   1>                 "node_name":"127.0.0.1:51322_solr",
[junit4:junit4]   1>                 "base_url":"http://127.0.0.1:51322/solr",
[junit4:junit4]   1>                 "leader":"true"}}}},
[junit4:junit4]   1>         "control_collection":{"control_shard":{"replicas":{"127.0.0.1:60298_solr_collection1":{
[junit4:junit4]   1>                 "shard":"control_shard",
[junit4:junit4]   1>                 "roles":null,
[junit4:junit4]   1>                 "state":"active",
[junit4:junit4]   1>                 "core":"collection1",
[junit4:junit4]   1>                 "collection":"control_collection",
[junit4:junit4]   1>                 "node_name":"127.0.0.1:60298_solr",
[junit4:junit4]   1>                 "base_url":"http://127.0.0.1:60298/solr",
[junit4:junit4]   1>                 "leader":"true"}}}}}
[junit4:junit4]   1>  /zookeeper (1)
[junit4:junit4]   1>  DATA:
[junit4:junit4]   1>      
[junit4:junit4]   1> 
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=BasicDistributedZk2Test -Dtests.method=testDistribSearch -Dtests.seed=1598D2695BA3CD59 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ro_RO -Dtests.timezone=SystemV/AST4 -Dtests.file.encoding=UTF-8
[junit4:junit4] FAILURE  575s J1 | BasicDistributedZk2Test.testDistribSearch <<<
[junit4:junit4]    > Throwable #1: java.lang.AssertionError: There are still nodes recoverying - waited for 540 seconds
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([1598D2695BA3CD59:947E5C712CFCAD65]:0)
[junit4:junit4]    > 	at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:165)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:115)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:110)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:563)
[junit4:junit4]    > 	at org.apache.solr.cloud.BasicDistributedZk2Test.brindDownShardIndexSomeDocsAndRecover(BasicDistributedZk2Test.java:321)
[junit4:junit4]    > 	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:83)
[junit4:junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
[junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:597)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:662)
[junit4:junit4]   2> 574526 T103 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> NOTE: test params are: codec=Asserting, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=ro_RO, timezone=SystemV/AST4
[junit4:junit4]   2> NOTE: Linux 3.2.0-34-generic amd64/Sun Microsystems Inc. 1.6.0_37 (64-bit)/cpus=8,threads=1,free=60741312,total=101134336
[junit4:junit4]   2> NOTE: All tests run in this JVM: [TestCSVLoader, TestArbitraryIndexDir, TestCodecSupport, IndexSchemaRuntimeFieldTest, DistributedQueryElevationComponentTest, StandardRequestHandlerTest, TestFoldingMultitermQuery, SuggesterTSTTest, ClusterStateTest, TestSolr4Spatial, DebugComponentTest, BasicDistributedZk2Test]
[junit4:junit4] Completed on J1 in 574.57s, 1 test, 1 failure <<< FAILURES!

[...truncated 482 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:352: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:178: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:438: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1171: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:835: There were test failures: 239 suites, 994 tests, 1 error, 1 failure, 7 ignored (2 assumptions)

Total time: 34 minutes 2 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 64bit/jdk1.6.0_37 -XX:+UseConcMarkSweepGC
Email was triggered for: Failure
Sending email for trigger: Failure



Re: [JENKINS] Lucene-Solr-4.x-Linux (64bit/jdk1.7.0_09) - Build # 3172 - Still Failing!

Posted by Mark Miller <ma...@gmail.com>.
This failed with an issue just like what was reported on the user list when someone was testing solrcloud on 4.x

Read past end of file error while trying to open on a replicated index. The reason is that all the files that come down have no content - but for some reason the replication does not fail.

After this, it just keeps trying to recover, but this seems to continue happening.

I have not seen this on 5x yet, just 4x.

- Mark

[junit4:junit4]   2> 551641 T2142 C254 P33656 oasc.SolrException.log SEVERE SnapPull failed :org.apache.solr.common.SolrException: Index fetch failed : 
[junit4:junit4]   2> 		at org.apache.solr.handler.SnapPuller.fetchLatestIndex(SnapPuller.java:400)
[junit4:junit4]   2> 		at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:297)
[junit4:junit4]   2> 		at org.apache.solr.cloud.RecoveryStrategy.replicate(RecoveryStrategy.java:153)
[junit4:junit4]   2> 		at org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:408)
[junit4:junit4]   2> 		at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:223)
[junit4:junit4]   2> 	Caused by: java.io.EOFException: read past EOF: MMapIndexInput(path="/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1355270616329/jetty2/index.20121211201247877/segments_k")
[junit4:junit4]   2> 		at org.apache.lucene.store.ByteBufferIndexInput.readByte(ByteBufferIndexInput.java:77)
[junit4:junit4]   2> 		at org.apache.lucene.store.ChecksumIndexInput.readByte(ChecksumIndexInput.java:41)
[junit4:junit4]   2> 		at org.apache.lucene.store.DataInput.readInt(DataInput.java:84)
[junit4:junit4]   2> 		at org.apache.lucene.index.SegmentInfos.read(SegmentInfos.java:287)
[junit4:junit4]   2> 		at org.apache.lucene.index.SegmentInfos$1.doBody(SegmentInfos.java:347)
[junit4:junit4]   2> 		at org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:783)
[junit4:junit4]   2> 		at org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:630)
[junit4:junit4]   2> 		at org.apache.lucene.index.SegmentInfos.read(SegmentInfos.java:343)
[junit4:junit4]   2> 		at org.apache.lucene.index.IndexWriter.<init>(IndexWriter.java:647)
[junit4:junit4]   2> 		at org.apache.solr.update.SolrIndexWriter.<init>(SolrIndexWriter.java:75)
[junit4:junit4]   2> 		at org.apache.solr.update.SolrIndexWriter.create(SolrIndexWriter.java:62)
[junit4:junit4]   2> 		at org.apache.solr.update.DefaultSolrCoreState.createMainIndexWriter(DefaultSolrCoreState.java:181)
[junit4:junit4]   2> 		at org.apache.solr.update.DefaultSolrCoreState.getIndexWriter(DefaultSolrCoreState.java:96)
[junit4:junit4]   2> 		at org.apache.solr.handler.SnapPuller.fetchLatestIndex(SnapPuller.java:354)
[junit4:junit4]   2> 		... 4 more



On Dec 11, 2012, at 7:13 PM, Policeman Jenkins Server <je...@sd-datasolutions.de> wrote:

> Build: http://jenkins.sd-datasolutions.de/job/Lucene-Solr-4.x-Linux/3172/
> Java: 64bit/jdk1.7.0_09 -XX:+UseParallelGC
> 
> 2 tests failed.
> FAILED:  org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch
> 
> Error Message:
> There are still nodes recoverying - waited for 540 seconds
> 
> Stack Trace:
> java.lang.AssertionError: There are still nodes recoverying - waited for 540 seconds
> 	at __randomizedtesting.SeedInfo.seed([A672C1073219D55D:27944F1F4546B561]:0)
> 	at org.junit.Assert.fail(Assert.java:93)
> 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:165)
> 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:115)
> 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:110)
> 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:563)
> 	at org.apache.solr.cloud.BasicDistributedZk2Test.brindDownShardIndexSomeDocsAndRecover(BasicDistributedZk2Test.java:321)
> 	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:83)
> 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:601)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
> 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
> 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> 	at java.lang.Thread.run(Thread.java:722)
> 
> 
> FAILED:  org.apache.solr.cloud.BasicDistributedZkTest.testDistribSearch
> 
> Error Message:
> Server at http://127.0.0.1:38136/solr returned non ok status:500, message:Server Error
> 
> Stack Trace:
> org.apache.solr.common.SolrException: Server at http://127.0.0.1:38136/solr returned non ok status:500, message:Server Error
> 	at __randomizedtesting.SeedInfo.seed([A672C1073219D55D:27944F1F4546B561]:0)
> 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:372)
> 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
> 	at org.apache.solr.client.solrj.request.CoreAdminRequest.process(CoreAdminRequest.java:429)
> 	at org.apache.solr.client.solrj.request.CoreAdminRequest.getStatus(CoreAdminRequest.java:472)
> 	at org.apache.solr.cloud.BasicDistributedZkTest.collectStartTimes(BasicDistributedZkTest.java:959)
> 	at org.apache.solr.cloud.BasicDistributedZkTest.testCollectionsAPI(BasicDistributedZkTest.java:795)
> 	at org.apache.solr.cloud.BasicDistributedZkTest.doTest(BasicDistributedZkTest.java:343)
> 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:601)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
> 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
> 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> 	at java.lang.Thread.run(Thread.java:722)
> 
> 
> 
> 
> Build Log:
> [...truncated 8533 lines...]
> [junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZkTest
> [junit4:junit4]   2> 9 T19 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
> [junit4:junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZkTest-1355270173136
> [junit4:junit4]   2> 12 T19 oasc.ZkTestServer.run STARTING ZK TEST SERVER
> [junit4:junit4]   2> 14 T20 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
> [junit4:junit4]   2> 35 T20 oaz.Environment.logEnv Server environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
> [junit4:junit4]   2> 36 T20 oaz.Environment.logEnv Server environment:host.name=serv1
> [junit4:junit4]   2> 36 T20 oaz.Environment.logEnv Server environment:java.version=1.7.0_09
> [junit4:junit4]   2> 36 T20 oaz.Environment.logEnv Server environment:java.vendor=Oracle Corporation
> [junit4:junit4]   2> 37 T20 oaz.Environment.logEnv Server environment:java.home=/mnt/ssd/jenkins/tools/java/64bit/jdk1.7.0_09/jre
> [junit4:junit4]   2> 37 T20 oaz.Environment.logEnv Server environment:java.class.path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/test:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/codecs/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-solrj/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/common/lucene-analyzers-common-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/highlighter/lucene-highlighter-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/memory/lucene-memory-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/misc/lucene-misc-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/spatial/lucene-spatial-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/suggest/lucene-suggest-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/grouping/lucene-grouping-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queries/lucene-queries-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queryparser/lucene-queryparser-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/cglib-nodep-2.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-cli-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-codec-1.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-fileupload-1.2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-lang-2.6.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/easymock-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/guava-13.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/javax.servlet-api-3.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/metrics-core-2.1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/objenesis-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/spatial4j-0.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/commons-io-2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpclient-4.1.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpcore-4.1.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpmime-4.1.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/jcl-over-slf4j-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/log4j-over-slf4j-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-api-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-jdk14-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/wstx-asl-3.2.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/zookeeper-3.4.5.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-continuation-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-deploy-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-http-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-io-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-jmx-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-security-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-server-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-servlet-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-util-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-webapp-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-xml-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/servlet-api-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/hsqldb-1.8.0.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/junit-4.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/randomizedtesting-runner-2.0.5.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-launcher.jar:/var/lib/jenkins/.ant/lib/ivy-2.2.0.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jdepend.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-netrexx.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-antlr.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-commons-net.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-javamail.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-regexp.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jsch.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-xalan2.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-junit4.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jmf.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-junit.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-bcel.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jai.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-commons-logging.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-resolver.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-oro.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-swing.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-bsf.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-log4j.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-testutil.jar:/mnt/ssd/jenkins/tools/java/64bit/jdk1.7.0_09/lib/tools.jar:/var/lib/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.0.5.jar
> [junit4:junit4]   2> 38 T20 oaz.Environment.logEnv Server environment:java.library.path=/mnt/ssd/jenkins/tools/java/64bit/jdk1.7.0_09/jre/lib/amd64/server:/mnt/ssd/jenkins/tools/java/64bit/jdk1.7.0_09/jre/lib/amd64:/mnt/ssd/jenkins/tools/java/64bit/jdk1.7.0_09/jre/../lib/amd64:/usr/lib/jvm/j2sdk1.6-sun/jre/lib/amd64/server:/usr/lib/jvm/j2sdk1.6-sun/jre/lib/amd64:/usr/lib/jvm/j2sdk1.6-sun/jre/../lib/amd64:/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
> [junit4:junit4]   2> 38 T20 oaz.Environment.logEnv Server environment:java.io.tmpdir=.
> [junit4:junit4]   2> 39 T20 oaz.Environment.logEnv Server environment:java.compiler=<NA>
> [junit4:junit4]   2> 39 T20 oaz.Environment.logEnv Server environment:os.name=Linux
> [junit4:junit4]   2> 39 T20 oaz.Environment.logEnv Server environment:os.arch=amd64
> [junit4:junit4]   2> 39 T20 oaz.Environment.logEnv Server environment:os.version=3.2.0-34-generic
> [junit4:junit4]   2> 40 T20 oaz.Environment.logEnv Server environment:user.name=jenkins
> [junit4:junit4]   2> 40 T20 oaz.Environment.logEnv Server environment:user.home=/var/lib/jenkins
> [junit4:junit4]   2> 40 T20 oaz.Environment.logEnv Server environment:user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
> [junit4:junit4]   2> 51 T20 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
> [junit4:junit4]   2> 52 T20 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
> [junit4:junit4]   2> 52 T20 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
> [junit4:junit4]   2> 62 T20 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
> [junit4:junit4]   2> 84 T20 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/zookeeper/server1/data/version-2/snapshot.0
> [junit4:junit4]   2> 114 T19 oasc.ZkTestServer.run start zk server on port:40680
> [junit4:junit4]   2> 136 T19 oaz.Environment.logEnv Client environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
> [junit4:junit4]   2> 137 T19 oaz.Environment.logEnv Client environment:host.name=serv1
> [junit4:junit4]   2> 138 T19 oaz.Environment.logEnv Client environment:java.version=1.7.0_09
> [junit4:junit4]   2> 138 T19 oaz.Environment.logEnv Client environment:java.vendor=Oracle Corporation
> [junit4:junit4]   2> 139 T19 oaz.Environment.logEnv Client environment:java.home=/mnt/ssd/jenkins/tools/java/64bit/jdk1.7.0_09/jre
> [junit4:junit4]   2> 140 T19 oaz.Environment.logEnv Client environment:java.class.path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/test:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/codecs/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-solrj/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/common/lucene-analyzers-common-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/highlighter/lucene-highlighter-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/memory/lucene-memory-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/misc/lucene-misc-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/spatial/lucene-spatial-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/suggest/lucene-suggest-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/grouping/lucene-grouping-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queries/lucene-queries-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queryparser/lucene-queryparser-4.1-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/cglib-nodep-2.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-cli-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-codec-1.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-fileupload-1.2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-lang-2.6.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/easymock-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/guava-13.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/javax.servlet-api-3.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/metrics-core-2.1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/objenesis-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/spatial4j-0.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/commons-io-2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpclient-4.1.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpcore-4.1.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpmime-4.1.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/jcl-over-slf4j-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/log4j-over-slf4j-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-api-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-jdk14-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/wstx-asl-3.2.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/zookeeper-3.4.5.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-continuation-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-deploy-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-http-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-io-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-jmx-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-security-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-server-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-servlet-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-util-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-webapp-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-xml-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/servlet-api-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/hsqldb-1.8.0.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/junit-4.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/randomizedtesting-runner-2.0.5.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-launcher.jar:/var/lib/jenkins/.ant/lib/ivy-2.2.0.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jdepend.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-netrexx.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-antlr.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-commons-net.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-javamail.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-regexp.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jsch.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-xalan2.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-junit4.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jmf.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-junit.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-bcel.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-jai.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-commons-logging.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-resolver.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-oro.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-swing.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-bsf.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-apache-log4j.jar:/var/lib/jenkins/tools/Ant/ANT_1.8.2/lib/ant-testutil.jar:/mnt/ssd/jenkins/tools/java/64bit/jdk1.7.0_09/lib/tools.jar:/var/lib/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.0.5.jar
> [junit4:junit4]   2> 141 T19 oaz.Environment.logEnv Client environment:java.library.path=/mnt/ssd/jenkins/tools/java/64bit/jdk1.7.0_09/jre/lib/amd64/server:/mnt/ssd/jenkins/tools/java/64bit/jdk1.7.0_09/jre/lib/amd64:/mnt/ssd/jenkins/tools/java/64bit/jdk1.7.0_09/jre/../lib/amd64:/usr/lib/jvm/j2sdk1.6-sun/jre/lib/amd64/server:/usr/lib/jvm/j2sdk1.6-sun/jre/lib/amd64:/usr/lib/jvm/j2sdk1.6-sun/jre/../lib/amd64:/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
> [junit4:junit4]   2> 142 T19 oaz.Environment.logEnv Client environment:java.io.tmpdir=.
> [junit4:junit4]   2> 143 T19 oaz.Environment.logEnv Client environment:java.compiler=<NA>
> [junit4:junit4]   2> 143 T19 oaz.Environment.logEnv Client environment:os.name=Linux
> [junit4:junit4]   2> 144 T19 oaz.Environment.logEnv Client environment:os.arch=amd64
> [junit4:junit4]   2> 145 T19 oaz.Environment.logEnv Client environment:os.version=3.2.0-34-generic
> [junit4:junit4]   2> 145 T19 oaz.Environment.logEnv Client environment:user.name=jenkins
> [junit4:junit4]   2> 146 T19 oaz.Environment.logEnv Client environment:user.home=/var/lib/jenkins
> [junit4:junit4]   2> 147 T19 oaz.Environment.logEnv Client environment:user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
> [junit4:junit4]   2> 149 T19 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:40680 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@5df2d944
> [junit4:junit4]   2> 180 T19 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4]   2> 185 T25 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:40680. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
> [junit4:junit4]   2> 188 T25 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:40680, initiating session
> [junit4:junit4]   2> 209 T21 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:35876
> [junit4:junit4]   2> 220 T21 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:35876
> [junit4:junit4]   2> 225 T23 oazsp.FileTxnLog.append Creating new log file: log.1
> [junit4:junit4]   2> 440 T23 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8c65b2230000 with negotiated timeout 10000 for client /127.0.0.1:35876
> [junit4:junit4]   2> 440 T25 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:40680, sessionid = 0x13b8c65b2230000, negotiated timeout = 10000
> [junit4:junit4]   2> 443 T26 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5df2d944 name:ZooKeeperConnection Watcher:127.0.0.1:40680 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4]   2> 443 T19 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4]   2> 446 T19 oascc.SolrZkClient.makePath makePath: /solr
> [junit4:junit4]   2> 472 T24 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8c65b2230000
> [junit4:junit4]   2> 474 T21 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:35876 which had sessionid 0x13b8c65b2230000
> [junit4:junit4]   2> 475 T26 oaz.ClientCnxn$EventThread.run EventThread shut down
> [junit4:junit4]   2> 475 T19 oaz.ZooKeeper.close Session: 0x13b8c65b2230000 closed
> [junit4:junit4]   2> 476 T19 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:40680/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1f58cce5
> [junit4:junit4]   2> 477 T19 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4]   2> 478 T27 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:40680. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
> [junit4:junit4]   2> 479 T27 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:40680, initiating session
> [junit4:junit4]   2> 479 T21 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:35877
> [junit4:junit4]   2> 480 T21 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:35877
> [junit4:junit4]   2> 481 T23 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8c65b2230001 with negotiated timeout 10000 for client /127.0.0.1:35877
> [junit4:junit4]   2> 481 T27 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:40680, sessionid = 0x13b8c65b2230001, negotiated timeout = 10000
> [junit4:junit4]   2> 482 T28 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f58cce5 name:ZooKeeperConnection Watcher:127.0.0.1:40680/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4]   2> 482 T19 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4]   2> 491 T19 oascc.SolrZkClient.makePath makePath: /collections/collection1
> [junit4:junit4]   2> 497 T19 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
> [junit4:junit4]   2> 503 T19 oascc.SolrZkClient.makePath makePath: /collections/control_collection
> [junit4:junit4]   2> 511 T19 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
> [junit4:junit4]   2> 516 T19 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
> [junit4:junit4]   2> 530 T19 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
> [junit4:junit4]   2> 547 T19 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
> [junit4:junit4]   2> 548 T19 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
> [junit4:junit4]   2> 554 T19 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
> [junit4:junit4]   2> 554 T19 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
> [junit4:junit4]   2> 563 T19 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
> [junit4:junit4]   2> 564 T19 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
> [junit4:junit4]   2> 569 T19 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
> [junit4:junit4]   2> 570 T19 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
> [junit4:junit4]   2> 574 T19 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
> [junit4:junit4]   2> 574 T19 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
> [junit4:junit4]   2> 578 T19 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
> [junit4:junit4]   2> 579 T19 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
> [junit4:junit4]   2> 583 T19 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
> [junit4:junit4]   2> 584 T19 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
> [junit4:junit4]   2> 590 T19 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
> [junit4:junit4]   2> 591 T19 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
> [junit4:junit4]   2> 596 T19 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
> [junit4:junit4]   2> 597 T19 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
> [junit4:junit4]   2> 601 T24 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8c65b2230001
> [junit4:junit4]   2> 602 T28 oaz.ClientCnxn$EventThread.run EventThread shut down
> [junit4:junit4]   2> 603 T21 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:35877 which had sessionid 0x13b8c65b2230001
> [junit4:junit4]   2> 603 T19 oaz.ZooKeeper.close Session: 0x13b8c65b2230001 closed
> [junit4:junit4]   2> 782 T19 oejs.Server.doStart jetty-8.1.8.v20121106
> [junit4:junit4]   2> 867 T19 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:40765
> [junit4:junit4]   2> 884 T19 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
> [junit4:junit4]   2> 885 T19 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355270173730
> [junit4:junit4]   2> 885 T19 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355270173730/'
> [junit4:junit4]   2> 901 T19 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
> [junit4:junit4]   2> 902 T19 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
> [junit4:junit4]   2> 902 T19 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355270173730
> [junit4:junit4]   2> 903 T19 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355270173730/solr.xml
> [junit4:junit4]   2> 903 T19 oasc.CoreContainer.<init> New CoreContainer 1460297432
> [junit4:junit4]   2> 904 T19 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355270173730/'
> [junit4:junit4]   2> 904 T19 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355270173730/'
> [junit4:junit4]   2> 929 T19 oasc.CoreContainer.load Registering Log Listener
> [junit4:junit4]   2> 940 T19 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:40680/solr
> [junit4:junit4]   2> 948 T19 oasc.ZkController.checkChrootPath zkHost includes chroot
> [junit4:junit4]   2> 948 T19 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:40680 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@7d6d9366
> [junit4:junit4]   2> 949 T19 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4]   2> 951 T39 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:40680. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
> [junit4:junit4]   2> 951 T39 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:40680, initiating session
> [junit4:junit4]   2> 952 T21 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:35878
> [junit4:junit4]   2> 952 T21 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:35878
> [junit4:junit4]   2> 953 T23 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8c65b2230002 with negotiated timeout 20000 for client /127.0.0.1:35878
> [junit4:junit4]   2> 953 T39 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:40680, sessionid = 0x13b8c65b2230002, negotiated timeout = 20000
> [junit4:junit4]   2> 954 T40 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7d6d9366 name:ZooKeeperConnection Watcher:127.0.0.1:40680 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4]   2> 954 T19 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4]   2> 956 T24 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8c65b2230002
> [junit4:junit4]   2> 957 T21 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:35878 which had sessionid 0x13b8c65b2230002
> [junit4:junit4]   2> 958 T40 oaz.ClientCnxn$EventThread.run EventThread shut down
> [junit4:junit4]   2> 957 T19 oaz.ZooKeeper.close Session: 0x13b8c65b2230002 closed
> [junit4:junit4]   2> 960 T19 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:40680/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@4a1c2a40
> [junit4:junit4]   2> 961 T19 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4]   2> 962 T41 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:40680. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
> [junit4:junit4]   2> 962 T41 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:40680, initiating session
> [junit4:junit4]   2> 963 T21 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:35879
> [junit4:junit4]   2> 963 T21 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:35879
> [junit4:junit4]   2> 964 T23 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8c65b2230003 with negotiated timeout 8000 for client /127.0.0.1:35879
> [junit4:junit4]   2> 964 T41 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:40680, sessionid = 0x13b8c65b2230003, negotiated timeout = 8000
> [junit4:junit4]   2> 965 T42 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4a1c2a40 name:ZooKeeperConnection Watcher:127.0.0.1:40680/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4]   2> 965 T19 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4]   2> 973 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b2230003 type:create cxid:0x2 zxid:0x1b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 979 T19 oascc.SolrZkClient.makePath makePath: /live_nodes
> [junit4:junit4]   2> 982 T19 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40765_solr
> [junit4:junit4]   2> 985 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b2230003 type:delete cxid:0x7 zxid:0x1d txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:40765_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:40765_solr
> [junit4:junit4]   2> 986 T19 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:40765_solr
> [junit4:junit4]   2> 990 T19 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
> [junit4:junit4]   2> 990 T19 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
> [junit4:junit4]   2> 991 T19 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
> [junit4:junit4]   2> 991 T19 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
> [junit4:junit4]   2> 992 T19 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
> [junit4:junit4]   2> 993 T19 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
> [junit4:junit4]   2> 993 T19 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
> [junit4:junit4]   2> 994 T19 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
> [junit4:junit4]   2> 994 T19 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
> [junit4:junit4]   2> 995 T19 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
> [junit4:junit4]   2> 1001 T19 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
> [junit4:junit4]   2> 1012 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b2230003 type:delete cxid:0x15 zxid:0x22 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
> [junit4:junit4]   2> 1013 T19 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
> [junit4:junit4]   2> 1017 T19 oasc.Overseer.start Overseer (id=88818986072080387-127.0.0.1:40765_solr-n_0000000000) starting
> [junit4:junit4]   2> 1018 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b2230003 type:create cxid:0x1a zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 1023 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b2230003 type:create cxid:0x1b zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 1024 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b2230003 type:create cxid:0x1c zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 1028 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b2230003 type:create cxid:0x1d zxid:0x27 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 1029 T44 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
> [junit4:junit4]   2> 1030 T19 oascc.SolrZkClient.makePath makePath: /clusterstate.json
> [junit4:junit4]   2> 1033 T19 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
> [junit4:junit4]   2> 1043 T43 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
> [junit4:junit4]   2> 1068 T45 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355270173730/collection1
> [junit4:junit4]   2> 1068 T45 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
> [junit4:junit4]   2> 1069 T45 oasc.ZkController.createCollectionZkNode Collection zkNode exists
> [junit4:junit4]   2> 1070 T45 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
> [junit4:junit4]   2> 1072 T45 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355270173730/collection1/'
> [junit4:junit4]   2> 1073 T45 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355270173730/collection1/lib/README' to classloader
> [junit4:junit4]   2> 1073 T45 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355270173730/collection1/lib/classes/' to classloader
> [junit4:junit4]   2> 1145 T45 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
> [junit4:junit4]   2> 1197 T45 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
> [junit4:junit4]   2> 1198 T45 oass.IndexSchema.readSchema Reading Solr Schema
> [junit4:junit4]   2> 1238 T45 oass.IndexSchema.readSchema Schema name=test
> [junit4:junit4]   2> 1634 T45 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
> [junit4:junit4]   2> 1644 T45 oass.IndexSchema.readSchema default search field in schema is text
> [junit4:junit4]   2> 1647 T45 oass.IndexSchema.readSchema unique key field: id
> [junit4:junit4]   2> 1684 T45 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4:junit4]   2> 1695 T45 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4:junit4]   2> 1704 T45 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4]   2> 1711 T45 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4]   2> 1718 T45 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1355270173730/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/control/data/
> [junit4:junit4]   2> 1723 T45 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bb8a8c6
> [junit4:junit4]   2> 1742 T45 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/control/data/index/
> [junit4:junit4]   2> 1743 T45 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/control/data/index' doesn't exist. Creating new index...
> [junit4:junit4]   2> 1750 T45 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/control/data/index forceNew:false
> [junit4:junit4]   2> 1758 T45 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
> [junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1d85813a; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
> [junit4:junit4]   2> 1759 T45 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
> [junit4:junit4]   2> 1766 T45 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
> [junit4:junit4]   2> 1785 T45 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
> [junit4:junit4]   2> 1785 T45 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
> [junit4:junit4]   2> 1786 T45 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
> [junit4:junit4]   2> 1788 T45 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
> [junit4:junit4]   2> 1808 T45 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
> [junit4:junit4]   2> 1809 T45 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
> [junit4:junit4]   2> 1810 T45 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
> [junit4:junit4]   2> 1814 T45 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
> [junit4:junit4]   2> 1819 T45 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
> [junit4:junit4]   2> 1831 T45 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
> [junit4:junit4]   2> 1834 T45 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
> [junit4:junit4]   2> 1835 T45 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
> [junit4:junit4]   2> 1837 T45 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
> [junit4:junit4]   2> 1837 T45 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
> [junit4:junit4]   2> 1838 T45 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
> [junit4:junit4]   2> 1842 T45 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
> [junit4:junit4]   2> 1844 T45 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 1846 T45 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 1847 T45 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 1849 T45 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 1851 T45 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 1853 T45 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 1855 T45 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 1860 T45 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
> [junit4:junit4]   2> 1866 T45 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
> [junit4:junit4]   2> 1869 T45 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
> [junit4:junit4]   2> 1870 T45 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
> [junit4:junit4]   2> 1874 T45 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
> [junit4:junit4]   2> 1877 T45 oass.SolrIndexSearcher.<init> Opening Searcher@cd89c9a main
> [junit4:junit4]   2> 1878 T45 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
> [junit4:junit4]   2> 1886 T45 oasu.CommitTracker.<init> Hard AutoCommit: disabled
> [junit4:junit4]   2> 1886 T45 oasu.CommitTracker.<init> Soft AutoCommit: disabled
> [junit4:junit4]   2> 1887 T45 oashc.SpellCheckComponent.inform Initializing spell checkers
> [junit4:junit4]   2> 1900 T45 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
> [junit4:junit4]   2> 1959 T46 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@cd89c9a main{StandardDirectoryReader(segments_1:1)}
> [junit4:junit4]   2> 1983 T45 oasc.ZkController.publish publishing core=collection1 state=down
> [junit4:junit4]   2> 1983 T45 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4]   2> 1984 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b2230003 type:create cxid:0x53 zxid:0x2a txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
> [junit4:junit4]   2> 1989 T45 oasc.CoreContainer.register registering core: collection1
> [junit4:junit4]   2> 1989 T45 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:40765/solr shardId:control_shard
> [junit4:junit4]   2> 1992 T45 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
> [junit4:junit4]   2> 1999 T45 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/control_shard/election
> [junit4:junit4]   2> 2008 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b2230003 type:delete cxid:0x62 zxid:0x31 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
> [junit4:junit4]   2> 2009 T45 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
> [junit4:junit4]   2> 2010 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b2230003 type:create cxid:0x63 zxid:0x32 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 2054 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 2056 T43 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
> [junit4:junit4]   2> 	  "operation":"state",
> [junit4:junit4]   2> 	  "numShards":null,
> [junit4:junit4]   2> 	  "shard":"control_shard",
> [junit4:junit4]   2> 	  "roles":null,
> [junit4:junit4]   2> 	  "state":"down",
> [junit4:junit4]   2> 	  "core":"collection1",
> [junit4:junit4]   2> 	  "collection":"control_collection",
> [junit4:junit4]   2> 	  "node_name":"127.0.0.1:40765_solr",
> [junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:40765/solr"}
> [junit4:junit4]   2> 2063 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b2230003 type:create cxid:0x6a zxid:0x34 txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
> [junit4:junit4]   2> 2090 T42 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
> [junit4:junit4]   2> 2513 T45 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
> [junit4:junit4]   2> 2514 T45 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
> [junit4:junit4]   2> 2515 T45 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:40765/solr/collection1/
> [junit4:junit4]   2> 2516 T45 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
> [junit4:junit4]   2> 2516 T45 oasc.SyncStrategy.syncToMe http://127.0.0.1:40765/solr/collection1/ has no replicas
> [junit4:junit4]   2> 2517 T45 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:40765/solr/collection1/
> [junit4:junit4]   2> 2518 T45 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/control_shard
> [junit4:junit4]   2> 2530 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b2230003 type:create cxid:0x89 zxid:0x3f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 2607 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 2620 T42 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
> [junit4:junit4]   2> 2635 T45 oasc.ZkController.register We are http://127.0.0.1:40765/solr/collection1/ and leader is http://127.0.0.1:40765/solr/collection1/
> [junit4:junit4]   2> 2637 T45 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:40765/solr
> [junit4:junit4]   2> 2638 T45 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
> [junit4:junit4]   2> 2639 T45 oasc.ZkController.publish publishing core=collection1 state=active
> [junit4:junit4]   2> 2639 T45 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4]   2> 2643 T45 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 2646 T19 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
> [junit4:junit4]   2> 2647 T19 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
> [junit4:junit4]   2> 2671 T19 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4]   2> 2752 T19 oejs.Server.doStart jetty-8.1.8.v20121106
> [junit4:junit4]   2> 2755 T19 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:45218
> [junit4:junit4]   2> 2756 T19 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
> [junit4:junit4]   2> 2756 T19 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355270175808
> [junit4:junit4]   2> 2757 T19 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355270175808/'
> [junit4:junit4]   2> 2774 T19 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
> [junit4:junit4]   2> 2775 T19 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
> [junit4:junit4]   2> 2775 T19 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355270175808
> [junit4:junit4]   2> 2775 T19 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355270175808/solr.xml
> [junit4:junit4]   2> 2776 T19 oasc.CoreContainer.<init> New CoreContainer 1217203756
> [junit4:junit4]   2> 2776 T19 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355270175808/'
> [junit4:junit4]   2> 2777 T19 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355270175808/'
> [junit4:junit4]   2> 2790 T19 oasc.CoreContainer.load Registering Log Listener
> [junit4:junit4]   2> 2799 T19 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:40680/solr
> [junit4:junit4]   2> 2799 T19 oasc.ZkController.checkChrootPath zkHost includes chroot
> [junit4:junit4]   2> 2800 T19 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:40680 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@70d488dc
> [junit4:junit4]   2> 2801 T19 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4]   2> 2801 T56 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:40680. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
> [junit4:junit4]   2> 2802 T56 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:40680, initiating session
> [junit4:junit4]   2> 2802 T21 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:35881
> [junit4:junit4]   2> 2803 T21 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:35881
> [junit4:junit4]   2> 2804 T23 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8c65b2230004 with negotiated timeout 20000 for client /127.0.0.1:35881
> [junit4:junit4]   2> 2804 T56 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:40680, sessionid = 0x13b8c65b2230004, negotiated timeout = 20000
> [junit4:junit4]   2> 2805 T57 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@70d488dc name:ZooKeeperConnection Watcher:127.0.0.1:40680 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4]   2> 2806 T19 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4]   2> 2808 T24 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8c65b2230004
> [junit4:junit4]   2> 2810 T57 oaz.ClientCnxn$EventThread.run EventThread shut down
> [junit4:junit4]   2> 2810 T19 oaz.ZooKeeper.close Session: 0x13b8c65b2230004 closed
> [junit4:junit4]   2> 2810 T21 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:35881 which had sessionid 0x13b8c65b2230004
> [junit4:junit4]   2> 2811 T19 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:40680/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@53885c6b
> [junit4:junit4]   2> 2812 T19 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4]   2> 2812 T58 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:40680. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
> [junit4:junit4]   2> 2813 T58 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:40680, initiating session
> [junit4:junit4]   2> 2814 T21 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:35882
> [junit4:junit4]   2> 2815 T21 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:35882
> [junit4:junit4]   2> 2816 T23 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8c65b2230005 with negotiated timeout 8000 for client /127.0.0.1:35882
> [junit4:junit4]   2> 2816 T58 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:40680, sessionid = 0x13b8c65b2230005, negotiated timeout = 8000
> [junit4:junit4]   2> 2817 T59 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@53885c6b name:ZooKeeperConnection Watcher:127.0.0.1:40680/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4]   2> 2818 T19 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4]   2> 2819 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b2230005 type:create cxid:0x1 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 2821 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b2230005 type:create cxid:0x2 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 2824 T19 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45218_solr
> [junit4:junit4]   2> 2825 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b2230005 type:delete cxid:0x4 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:45218_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:45218_solr
> [junit4:junit4]   2> 2827 T19 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:45218_solr
> [junit4:junit4]   2> 2831 T42 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
> [junit4:junit4]   2> 2834 T19 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
> [junit4:junit4]   2> 2835 T19 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
> [junit4:junit4]   2> 2837 T19 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
> [junit4:junit4]   2> 2837 T42 oascc.ZkStateReader$3.process Updating live nodes... (2)
> [junit4:junit4]   2> 2837 T19 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
> [junit4:junit4]   2> 2838 T19 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
> [junit4:junit4]   2> 2839 T19 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
> [junit4:junit4]   2> 2840 T19 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
> [junit4:junit4]   2> 2841 T19 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
> [junit4:junit4]   2> 2842 T19 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
> [junit4:junit4]   2> 2843 T19 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
> [junit4:junit4]   2> 2862 T19 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
> [junit4:junit4]   2> 2877 T60 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355270175808/collection1
> [junit4:junit4]   2> 2878 T60 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
> [junit4:junit4]   2> 2879 T60 oasc.ZkController.createCollectionZkNode Collection zkNode exists
> [junit4:junit4]   2> 2880 T60 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
> [junit4:junit4]   2> 2883 T60 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355270175808/collection1/'
> [junit4:junit4]   2> 2885 T60 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty1-1355270175808/collection1/lib/README' to classloader
> [junit4:junit4]   2> 2885 T60 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty1-1355270175808/collection1/lib/classes/' to classloader
> [junit4:junit4]   2> 2960 T60 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
> [junit4:junit4]   2> 3003 T60 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
> [junit4:junit4]   2> 3004 T60 oass.IndexSchema.readSchema Reading Solr Schema
> [junit4:junit4]   2> 3036 T60 oass.IndexSchema.readSchema Schema name=test
> [junit4:junit4]   2> 3129 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 3131 T43 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
> [junit4:junit4]   2> 	  "operation":"state",
> [junit4:junit4]   2> 	  "numShards":null,
> [junit4:junit4]   2> 	  "shard":"control_shard",
> [junit4:junit4]   2> 	  "roles":null,
> [junit4:junit4]   2> 	  "state":"active",
> [junit4:junit4]   2> 	  "core":"collection1",
> [junit4:junit4]   2> 	  "collection":"control_collection",
> [junit4:junit4]   2> 	  "node_name":"127.0.0.1:40765_solr",
> [junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:40765/solr"}
> [junit4:junit4]   2> 3137 T59 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
> [junit4:junit4]   2> 3137 T42 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
> [junit4:junit4]   2> 3390 T60 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
> [junit4:junit4]   2> 3400 T60 oass.IndexSchema.readSchema default search field in schema is text
> [junit4:junit4]   2> 3402 T60 oass.IndexSchema.readSchema unique key field: id
> [junit4:junit4]   2> 3428 T60 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4:junit4]   2> 3433 T60 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4:junit4]   2> 3437 T60 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4]   2> 3440 T60 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4]   2> 3444 T60 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty1-1355270175808/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty1/
> [junit4:junit4]   2> 3444 T60 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bb8a8c6
> [junit4:junit4]   2> 3445 T60 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty1/index/
> [junit4:junit4]   2> 3445 T60 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty1/index' doesn't exist. Creating new index...
> [junit4:junit4]   2> 3446 T60 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty1/index forceNew:false
> [junit4:junit4]   2> 3450 T60 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
> [junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@28f1d4e2; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
> [junit4:junit4]   2> 3450 T60 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
> [junit4:junit4]   2> 3451 T60 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
> [junit4:junit4]   2> 3453 T60 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
> [junit4:junit4]   2> 3454 T60 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
> [junit4:junit4]   2> 3454 T60 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
> [junit4:junit4]   2> 3454 T60 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
> [junit4:junit4]   2> 3455 T60 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
> [junit4:junit4]   2> 3455 T60 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
> [junit4:junit4]   2> 3456 T60 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
> [junit4:junit4]   2> 3458 T60 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
> [junit4:junit4]   2> 3460 T60 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
> [junit4:junit4]   2> 3462 T60 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
> [junit4:junit4]   2> 3464 T60 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
> [junit4:junit4]   2> 3465 T60 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
> [junit4:junit4]   2> 3467 T60 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
> [junit4:junit4]   2> 3467 T60 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
> [junit4:junit4]   2> 3468 T60 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
> [junit4:junit4]   2> 3470 T60 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
> [junit4:junit4]   2> 3472 T60 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 3474 T60 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 3476 T60 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 3479 T60 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 3481 T60 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 3483 T60 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 3485 T60 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 3487 T60 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
> [junit4:junit4]   2> 3489 T60 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
> [junit4:junit4]   2> 3492 T60 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
> [junit4:junit4]   2> 3493 T60 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
> [junit4:junit4]   2> 3497 T60 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
> [junit4:junit4]   2> 3499 T60 oass.SolrIndexSearcher.<init> Opening Searcher@4482d3a3 main
> [junit4:junit4]   2> 3500 T60 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
> [junit4:junit4]   2> 3501 T60 oasu.CommitTracker.<init> Hard AutoCommit: disabled
> [junit4:junit4]   2> 3501 T60 oasu.CommitTracker.<init> Soft AutoCommit: disabled
> [junit4:junit4]   2> 3502 T60 oashc.SpellCheckComponent.inform Initializing spell checkers
> [junit4:junit4]   2> 3507 T60 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
> [junit4:junit4]   2> 3549 T61 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4482d3a3 main{StandardDirectoryReader(segments_1:1)}
> [junit4:junit4]   2> 3566 T60 oasc.ZkController.publish publishing core=collection1 state=down
> [junit4:junit4]   2> 3567 T60 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4]   2> 3645 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 3646 T43 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
> [junit4:junit4]   2> 	  "operation":"state",
> [junit4:junit4]   2> 	  "numShards":"2",
> [junit4:junit4]   2> 	  "shard":null,
> [junit4:junit4]   2> 	  "roles":null,
> [junit4:junit4]   2> 	  "state":"down",
> [junit4:junit4]   2> 	  "core":"collection1",
> [junit4:junit4]   2> 	  "collection":"collection1",
> [junit4:junit4]   2> 	  "node_name":"127.0.0.1:45218_solr",
> [junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:45218/solr"}
> [junit4:junit4]   2> 3647 T43 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
> [junit4:junit4]   2> 3649 T43 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
> [junit4:junit4]   2> 3654 T42 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
> [junit4:junit4]   2> 3654 T59 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
> [junit4:junit4]   2> 4070 T60 oasc.CoreContainer.register registering core: collection1
> [junit4:junit4]   2> 4071 T60 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:45218/solr shardId:shard1
> [junit4:junit4]   2> 4073 T60 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
> [junit4:junit4]   2> 4091 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b2230005 type:delete cxid:0x45 zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
> [junit4:junit4]   2> 4093 T60 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
> [junit4:junit4]   2> 4094 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b2230005 type:create cxid:0x46 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 4099 T60 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
> [junit4:junit4]   2> 4099 T60 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
> [junit4:junit4]   2> 4100 T60 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:45218/solr/collection1/
> [junit4:junit4]   2> 4100 T60 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
> [junit4:junit4]   2> 4101 T60 oasc.SyncStrategy.syncToMe http://127.0.0.1:45218/solr/collection1/ has no replicas
> [junit4:junit4]   2> 4101 T60 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:45218/solr/collection1/
> [junit4:junit4]   2> 4102 T60 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
> [junit4:junit4]   2> 4114 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b2230005 type:create cxid:0x50 zxid:0x60 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 4163 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 4184 T42 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
> [junit4:junit4]   2> 4184 T59 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
> [junit4:junit4]   2> 4219 T60 oasc.ZkController.register We are http://127.0.0.1:45218/solr/collection1/ and leader is http://127.0.0.1:45218/solr/collection1/
> [junit4:junit4]   2> 4219 T60 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:45218/solr
> [junit4:junit4]   2> 4220 T60 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
> [junit4:junit4]   2> 4220 T60 oasc.ZkController.publish publishing core=collection1 state=active
> [junit4:junit4]   2> 4221 T60 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4]   2> 4225 T60 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 4228 T19 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
> [junit4:junit4]   2> 4228 T19 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
> [junit4:junit4]   2> 4229 T19 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4]   2> 4286 T19 oejs.Server.doStart jetty-8.1.8.v20121106
> [junit4:junit4]   2> 4290 T19 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:38136
> [junit4:junit4]   2> 4290 T19 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
> [junit4:junit4]   2> 4291 T19 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355270177363
> [junit4:junit4]   2> 4291 T19 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355270177363/'
> [junit4:junit4]   2> 4304 T19 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
> [junit4:junit4]   2> 4304 T19 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
> [junit4:junit4]   2> 4305 T19 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355270177363
> [junit4:junit4]   2> 4305 T19 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355270177363/solr.xml
> [junit4:junit4]   2> 4305 T19 oasc.CoreContainer.<init> New CoreContainer 1474479830
> [junit4:junit4]   2> 4306 T19 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355270177363/'
> [junit4:junit4]   2> 4306 T19 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355270177363/'
> [junit4:junit4]   2> 4320 T19 oasc.CoreContainer.load Registering Log Listener
> [junit4:junit4]   2> 4329 T19 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:40680/solr
> [junit4:junit4]   2> 4329 T19 oasc.ZkController.checkChrootPath zkHost includes chroot
> [junit4:junit4]   2> 4329 T19 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:40680 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@288ba95
> [junit4:junit4]   2> 4330 T19 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4]   2> 4331 T71 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:40680. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
> [junit4:junit4]   2> 4332 T71 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:40680, initiating session
> [junit4:junit4]   2> 4332 T21 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:35883
> [junit4:junit4]   2> 4333 T21 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:35883
> [junit4:junit4]   2> 4335 T23 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8c65b2230006 with negotiated timeout 20000 for client /127.0.0.1:35883
> [junit4:junit4]   2> 4335 T71 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:40680, sessionid = 0x13b8c65b2230006, negotiated timeout = 20000
> [junit4:junit4]   2> 4336 T72 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@288ba95 name:ZooKeeperConnection Watcher:127.0.0.1:40680 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4]   2> 4337 T19 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4]   2> 4340 T24 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8c65b2230006
> [junit4:junit4]   2> 4341 T21 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:35883 which had sessionid 0x13b8c65b2230006
> [junit4:junit4]   2> 4341 T72 oaz.ClientCnxn$EventThread.run EventThread shut down
> [junit4:junit4]   2> 4341 T19 oaz.ZooKeeper.close Session: 0x13b8c65b2230006 closed
> [junit4:junit4]   2> 4342 T19 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:40680/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@2e9dd554
> [junit4:junit4]   2> 4344 T19 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4]   2> 4344 T73 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:40680. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
> [junit4:junit4]   2> 4345 T73 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:40680, initiating session
> [junit4:junit4]   2> 4345 T21 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:35885
> [junit4:junit4]   2> 4346 T21 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:35885
> [junit4:junit4]   2> 4348 T23 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8c65b2230007 with negotiated timeout 8000 for client /127.0.0.1:35885
> [junit4:junit4]   2> 4348 T73 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:40680, sessionid = 0x13b8c65b2230007, negotiated timeout = 8000
> [junit4:junit4]   2> 4349 T74 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2e9dd554 name:ZooKeeperConnection Watcher:127.0.0.1:40680/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4]   2> 4350 T19 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4]   2> 4352 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b2230007 type:create cxid:0x1 zxid:0x6d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 4354 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b2230007 type:create cxid:0x2 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 4357 T19 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38136_solr
> [junit4:junit4]   2> 4359 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b2230007 type:delete cxid:0x4 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:38136_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:38136_solr
> [junit4:junit4]   2> 4360 T19 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:38136_solr
> [junit4:junit4]   2> 4365 T59 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
> [junit4:junit4]   2> 4365 T42 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
> [junit4:junit4]   2> 4367 T19 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
> [junit4:junit4]   2> 4368 T19 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
> [junit4:junit4]   2> 4369 T19 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
> [junit4:junit4]   2> 4370 T59 oascc.ZkStateReader$3.process Updating live nodes... (3)
> [junit4:junit4]   2> 4370 T42 oascc.ZkStateReader$3.process Updating live nodes... (3)
> [junit4:junit4]   2> 4370 T19 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
> [junit4:junit4]   2> 4371 T19 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
> [junit4:junit4]   2> 4372 T19 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
> [junit4:junit4]   2> 4373 T19 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
> [junit4:junit4]   2> 4373 T19 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
> [junit4:junit4]   2> 4374 T19 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
> [junit4:junit4]   2> 4375 T19 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
> [junit4:junit4]   2> 4389 T19 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
> [junit4:junit4]   2> 4403 T75 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355270177363/collection1
> [junit4:junit4]   2> 4403 T75 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
> [junit4:junit4]   2> 4405 T75 oasc.ZkController.createCollectionZkNode Collection zkNode exists
> [junit4:junit4]   2> 4406 T75 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
> [junit4:junit4]   2> 4409 T75 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355270177363/collection1/'
> [junit4:junit4]   2> 4411 T75 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty2-1355270177363/collection1/lib/README' to classloader
> [junit4:junit4]   2> 4412 T75 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty2-1355270177363/collection1/lib/classes/' to classloader
> [junit4:junit4]   2> 4460 T75 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
> [junit4:junit4]   2> 4502 T75 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
> [junit4:junit4]   2> 4504 T75 oass.IndexSchema.readSchema Reading Solr Schema
> [junit4:junit4]   2> 4525 T75 oass.IndexSchema.readSchema Schema name=test
> [junit4:junit4]   2> 4698 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 4700 T43 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
> [junit4:junit4]   2> 	  "operation":"state",
> [junit4:junit4]   2> 	  "numShards":"2",
> [junit4:junit4]   2> 	  "shard":"shard1",
> [junit4:junit4]   2> 	  "roles":null,
> [junit4:junit4]   2> 	  "state":"active",
> [junit4:junit4]   2> 	  "core":"collection1",
> [junit4:junit4]   2> 	  "collection":"collection1",
> [junit4:junit4]   2> 	  "node_name":"127.0.0.1:45218_solr",
> [junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:45218/solr"}
> [junit4:junit4]   2> 4706 T74 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
> [junit4:junit4]   2> 4706 T59 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
> [junit4:junit4]   2> 4706 T42 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
> [junit4:junit4]   2> 4860 T75 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
> [junit4:junit4]   2> 4869 T75 oass.IndexSchema.readSchema default search field in schema is text
> [junit4:junit4]   2> 4872 T75 oass.IndexSchema.readSchema unique key field: id
> [junit4:junit4]   2> 4902 T75 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4:junit4]   2> 4907 T75 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4:junit4]   2> 4912 T75 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4]   2> 4917 T75 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4]   2> 4922 T75 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty2-1355270177363/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty2/
> [junit4:junit4]   2> 4922 T75 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bb8a8c6
> [junit4:junit4]   2> 4924 T75 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty2/index/
> [junit4:junit4]   2> 4925 T75 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty2/index' doesn't exist. Creating new index...
> [junit4:junit4]   2> 4926 T75 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty2/index forceNew:false
> [junit4:junit4]   2> 4932 T75 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
> [junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3b63ecdd; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
> [junit4:junit4]   2> 4933 T75 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
> [junit4:junit4]   2> 4934 T75 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
> [junit4:junit4]   2> 4939 T75 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
> [junit4:junit4]   2> 4939 T75 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
> [junit4:junit4]   2> 4940 T75 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
> [junit4:junit4]   2> 4942 T75 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
> [junit4:junit4]   2> 4943 T75 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
> [junit4:junit4]   2> 4944 T75 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
> [junit4:junit4]   2> 4945 T75 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
> [junit4:junit4]   2> 4946 T75 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
> [junit4:junit4]   2> 4948 T75 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
> [junit4:junit4]   2> 4949 T75 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
> [junit4:junit4]   2> 4951 T75 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
> [junit4:junit4]   2> 4951 T75 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
> [junit4:junit4]   2> 4953 T75 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
> [junit4:junit4]   2> 4953 T75 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
> [junit4:junit4]   2> 4953 T75 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
> [junit4:junit4]   2> 4955 T75 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
> [junit4:junit4]   2> 4956 T75 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 4957 T75 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 4959 T75 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 4960 T75 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 4961 T75 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 4963 T75 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 4964 T75 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 4966 T75 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
> [junit4:junit4]   2> 4967 T75 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
> [junit4:junit4]   2> 4969 T75 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
> [junit4:junit4]   2> 4971 T75 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
> [junit4:junit4]   2> 4973 T75 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
> [junit4:junit4]   2> 4977 T75 oass.SolrIndexSearcher.<init> Opening Searcher@c63dc7c main
> [junit4:junit4]   2> 4977 T75 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
> [junit4:junit4]   2> 4979 T75 oasu.CommitTracker.<init> Hard AutoCommit: disabled
> [junit4:junit4]   2> 4979 T75 oasu.CommitTracker.<init> Soft AutoCommit: disabled
> [junit4:junit4]   2> 4981 T75 oashc.SpellCheckComponent.inform Initializing spell checkers
> [junit4:junit4]   2> 4985 T75 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
> [junit4:junit4]   2> 5042 T76 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@c63dc7c main{StandardDirectoryReader(segments_1:1)}
> [junit4:junit4]   2> 5058 T75 oasc.ZkController.publish publishing core=collection1 state=down
> [junit4:junit4]   2> 5058 T75 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4]   2> 5214 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 5216 T43 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
> [junit4:junit4]   2> 	  "operation":"state",
> [junit4:junit4]   2> 	  "numShards":"2",
> [junit4:junit4]   2> 	  "shard":null,
> [junit4:junit4]   2> 	  "roles":null,
> [junit4:junit4]   2> 	  "state":"down",
> [junit4:junit4]   2> 	  "core":"collection1",
> [junit4:junit4]   2> 	  "collection":"collection1",
> [junit4:junit4]   2> 	  "node_name":"127.0.0.1:38136_solr",
> [junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:38136/solr"}
> [junit4:junit4]   2> 5216 T43 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
> [junit4:junit4]   2> 5216 T43 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
> [junit4:junit4]   2> 5223 T74 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
> [junit4:junit4]   2> 5224 T59 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
> [junit4:junit4]   2> 5224 T42 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
> [junit4:junit4]   2> 5560 T75 oasc.CoreContainer.register registering core: collection1
> [junit4:junit4]   2> 5561 T75 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:38136/solr shardId:shard2
> [junit4:junit4]   2> 5563 T75 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
> [junit4:junit4]   2> 5575 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b2230007 type:delete cxid:0x44 zxid:0x7e txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard2 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard2
> [junit4:junit4]   2> 5575 T75 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
> [junit4:junit4]   2> 5576 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b2230007 type:create cxid:0x45 zxid:0x7f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 5579 T75 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
> [junit4:junit4]   2> 5580 T75 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
> [junit4:junit4]   2> 5581 T75 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:38136/solr/collection1/
> [junit4:junit4]   2> 5581 T75 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
> [junit4:junit4]   2> 5582 T75 oasc.SyncStrategy.syncToMe http://127.0.0.1:38136/solr/collection1/ has no replicas
> [junit4:junit4]   2> 5583 T75 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:38136/solr/collection1/
> [junit4:junit4]   2> 5584 T75 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
> [junit4:junit4]   2> 5591 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b2230007 type:create cxid:0x4e zxid:0x82 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 5730 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 5836 T42 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
> [junit4:junit4]   2> 5836 T74 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
> [junit4:junit4]   2> 5836 T59 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
> [junit4:junit4]   2> 5845 T75 oasc.ZkController.register We are http://127.0.0.1:38136/solr/collection1/ and leader is http://127.0.0.1:38136/solr/collection1/
> [junit4:junit4]   2> 5846 T75 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:38136/solr
> [junit4:junit4]   2> 5846 T75 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
> [junit4:junit4]   2> 5847 T75 oasc.ZkController.publish publishing core=collection1 state=active
> [junit4:junit4]   2> 5847 T75 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4]   2> 5849 T75 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 5851 T19 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
> [junit4:junit4]   2> 5852 T19 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
> [junit4:junit4]   2> 5852 T19 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4]   2> 5931 T19 oejs.Server.doStart jetty-8.1.8.v20121106
> [junit4:junit4]   2> 5934 T19 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:44139
> [junit4:junit4]   2> 5935 T19 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
> [junit4:junit4]   2> 5935 T19 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355270178983
> [junit4:junit4]   2> 5936 T19 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355270178983/'
> [junit4:junit4]   2> 5954 T19 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
> [junit4:junit4]   2> 5955 T19 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
> [junit4:junit4]   2> 5956 T19 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355270178983
> [junit4:junit4]   2> 5956 T19 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355270178983/solr.xml
> [junit4:junit4]   2> 5957 T19 oasc.CoreContainer.<init> New CoreContainer 1689588836
> [junit4:junit4]   2> 5958 T19 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355270178983/'
> [junit4:junit4]   2> 5958 T19 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355270178983/'
> [junit4:junit4]   2> 5988 T19 oasc.CoreContainer.load Registering Log Listener
> [junit4:junit4]   2> 6000 T19 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:40680/solr
> [junit4:junit4]   2> 6001 T19 oasc.ZkController.checkChrootPath zkHost includes chroot
> [junit4:junit4]   2> 6001 T19 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:40680 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@ebb3558
> [junit4:junit4]   2> 6002 T19 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4]   2> 6003 T86 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:40680. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
> [junit4:junit4]   2> 6004 T86 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:40680, initiating session
> [junit4:junit4]   2> 6004 T21 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:35887
> [junit4:junit4]   2> 6004 T21 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:35887
> [junit4:junit4]   2> 6005 T23 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8c65b2230008 with negotiated timeout 20000 for client /127.0.0.1:35887
> [junit4:junit4]   2> 6005 T86 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:40680, sessionid = 0x13b8c65b2230008, negotiated timeout = 20000
> [junit4:junit4]   2> 6006 T87 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ebb3558 name:ZooKeeperConnection Watcher:127.0.0.1:40680 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4]   2> 6006 T19 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4]   2> 6008 T24 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8c65b2230008
> [junit4:junit4]   2> 6009 T87 oaz.ClientCnxn$EventThread.run EventThread shut down
> [junit4:junit4]   2> 6009 T19 oaz.ZooKeeper.close Session: 0x13b8c65b2230008 closed
> [junit4:junit4]   2> 6009 T21 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:35887 which had sessionid 0x13b8c65b2230008
> [junit4:junit4]   2> 6010 T19 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:40680/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@15571a74
> [junit4:junit4]   2> 6011 T19 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4]   2> 6011 T88 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:40680. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
> [junit4:junit4]   2> 6012 T88 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:40680, initiating session
> [junit4:junit4]   2> 6012 T21 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:35888
> [junit4:junit4]   2> 6012 T21 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:35888
> [junit4:junit4]   2> 6013 T23 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8c65b2230009 with negotiated timeout 8000 for client /127.0.0.1:35888
> [junit4:junit4]   2> 6013 T88 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:40680, sessionid = 0x13b8c65b2230009, negotiated timeout = 8000
> [junit4:junit4]   2> 6014 T89 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@15571a74 name:ZooKeeperConnection Watcher:127.0.0.1:40680/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4]   2> 6014 T19 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4]   2> 6015 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b2230009 type:create cxid:0x1 zxid:0x8f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 6017 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b2230009 type:create cxid:0x2 zxid:0x90 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 6018 T19 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44139_solr
> [junit4:junit4]   2> 6019 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b2230009 type:delete cxid:0x4 zxid:0x91 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:44139_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:44139_solr
> [junit4:junit4]   2> 6020 T19 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:44139_solr
> [junit4:junit4]   2> 6023 T42 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
> [junit4:junit4]   2> 6023 T74 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
> [junit4:junit4]   2> 6023 T59 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
> [junit4:junit4]   2> 6025 T19 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
> [junit4:junit4]   2> 6025 T74 oascc.ZkStateReader$3.process Updating live nodes... (4)
> [junit4:junit4]   2> 6026 T19 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
> [junit4:junit4]   2> 6026 T59 oascc.ZkStateReader$3.process Updating live nodes... (4)
> [junit4:junit4]   2> 6026 T42 oascc.ZkStateReader$3.process Updating live nodes... (4)
> [junit4:junit4]   2> 6026 T19 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
> [junit4:junit4]   2> 6027 T19 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
> [junit4:junit4]   2> 6027 T19 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
> [junit4:junit4]   2> 6028 T19 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
> [junit4:junit4]   2> 6028 T19 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
> [junit4:junit4]   2> 6028 T19 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
> [junit4:junit4]   2> 6029 T19 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
> [junit4:junit4]   2> 6029 T19 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
> [junit4:junit4]   2> 6037 T19 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
> [junit4:junit4]   2> 6044 T90 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355270178983/collection1
> [junit4:junit4]   2> 6044 T90 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
> [junit4:junit4]   2> 6045 T90 oasc.ZkController.createCollectionZkNode Collection zkNode exists
> [junit4:junit4]   2> 6046 T90 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
> [junit4:junit4]   2> 6047 T90 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355270178983/collection1/'
> [junit4:junit4]   2> 6048 T90 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty3-1355270178983/collection1/lib/README' to classloader
> [junit4:junit4]   2> 6048 T90 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty3-1355270178983/collection1/lib/classes/' to classloader
> [junit4:junit4]   2> 6083 T90 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
> [junit4:junit4]   2> 6124 T90 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
> [junit4:junit4]   2> 6126 T90 oass.IndexSchema.readSchema Reading Solr Schema
> [junit4:junit4]   2> 6144 T90 oass.IndexSchema.readSchema Schema name=test
> [junit4:junit4]   2> 6346 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 6348 T43 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
> [junit4:junit4]   2> 	  "operation":"state",
> [junit4:junit4]   2> 	  "numShards":"2",
> [junit4:junit4]   2> 	  "shard":"shard2",
> [junit4:junit4]   2> 	  "roles":null,
> [junit4:junit4]   2> 	  "state":"active",
> [junit4:junit4]   2> 	  "core":"collection1",
> [junit4:junit4]   2> 	  "collection":"collection1",
> [junit4:junit4]   2> 	  "node_name":"127.0.0.1:38136_solr",
> [junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:38136/solr"}
> [junit4:junit4]   2> 6356 T74 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
> [junit4:junit4]   2> 6356 T59 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
> [junit4:junit4]   2> 6356 T42 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
> [junit4:junit4]   2> 6356 T89 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
> [junit4:junit4]   2> 6556 T90 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
> [junit4:junit4]   2> 6570 T90 oass.IndexSchema.readSchema default search field in schema is text
> [junit4:junit4]   2> 6574 T90 oass.IndexSchema.readSchema unique key field: id
> [junit4:junit4]   2> 6609 T90 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4:junit4]   2> 6614 T90 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4:junit4]   2> 6618 T90 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4]   2> 6632 T90 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4]   2> 6635 T90 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty3-1355270178983/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty3/
> [junit4:junit4]   2> 6636 T90 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bb8a8c6
> [junit4:junit4]   2> 6638 T90 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty3/index/
> [junit4:junit4]   2> 6639 T90 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty3/index' doesn't exist. Creating new index...
> [junit4:junit4]   2> 6639 T90 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty3/index forceNew:false
> [junit4:junit4]   2> 6707 T90 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
> [junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@39731fbd; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
> [junit4:junit4]   2> 6708 T90 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
> [junit4:junit4]   2> 6708 T90 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
> [junit4:junit4]   2> 6711 T90 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
> [junit4:junit4]   2> 6711 T90 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
> [junit4:junit4]   2> 6712 T90 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
> [junit4:junit4]   2> 6712 T90 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
> [junit4:junit4]   2> 6713 T90 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
> [junit4:junit4]   2> 6713 T90 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
> [junit4:junit4]   2> 6714 T90 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
> [junit4:junit4]   2> 6715 T90 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
> [junit4:junit4]   2> 6717 T90 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
> [junit4:junit4]   2> 6718 T90 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
> [junit4:junit4]   2> 6719 T90 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
> [junit4:junit4]   2> 6720 T90 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
> [junit4:junit4]   2> 6721 T90 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
> [junit4:junit4]   2> 6721 T90 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
> [junit4:junit4]   2> 6722 T90 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
> [junit4:junit4]   2> 6723 T90 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
> [junit4:junit4]   2> 6724 T90 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 6726 T90 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 6727 T90 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 6729 T90 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 6730 T90 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 6731 T90 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 6733 T90 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 6734 T90 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
> [junit4:junit4]   2> 6736 T90 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
> [junit4:junit4]   2> 6738 T90 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
> [junit4:junit4]   2> 6740 T90 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
> [junit4:junit4]   2> 6743 T90 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
> [junit4:junit4]   2> 6746 T90 oass.SolrIndexSearcher.<init> Opening Searcher@3e6bb568 main
> [junit4:junit4]   2> 6746 T90 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
> [junit4:junit4]   2> 6747 T90 oasu.CommitTracker.<init> Hard AutoCommit: disabled
> [junit4:junit4]   2> 6748 T90 oasu.CommitTracker.<init> Soft AutoCommit: disabled
> [junit4:junit4]   2> 6749 T90 oashc.SpellCheckComponent.inform Initializing spell checkers
> [junit4:junit4]   2> 6753 T90 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
> [junit4:junit4]   2> 6795 T91 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3e6bb568 main{StandardDirectoryReader(segments_1:1)}
> [junit4:junit4]   2> 6806 T90 oasc.ZkController.publish publishing core=collection1 state=down
> [junit4:junit4]   2> 6807 T90 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4]   2> 6865 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 6866 T43 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
> [junit4:junit4]   2> 	  "operation":"state",
> [junit4:junit4]   2> 	  "numShards":"2",
> [junit4:junit4]   2> 	  "shard":null,
> [junit4:junit4]   2> 	  "roles":null,
> [junit4:junit4]   2> 	  "state":"down",
> [junit4:junit4]   2> 	  "core":"collection1",
> [junit4:junit4]   2> 	  "collection":"collection1",
> [junit4:junit4]   2> 	  "node_name":"127.0.0.1:44139_solr",
> [junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:44139/solr"}
> [junit4:junit4]   2> 6866 T43 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
> [junit4:junit4]   2> 6867 T43 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
> [junit4:junit4]   2> 6872 T42 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
> [junit4:junit4]   2> 6872 T89 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
> [junit4:junit4]   2> 6872 T59 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
> [junit4:junit4]   2> 6872 T74 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
> [junit4:junit4]   2> 7308 T90 oasc.CoreContainer.register registering core: collection1
> [junit4:junit4]   2> 7309 T90 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:44139/solr shardId:shard1
> [junit4:junit4]   2> 7314 T90 oasc.ZkController.register We are http://127.0.0.1:44139/solr/collection1/ and leader is http://127.0.0.1:45218/solr/collection1/
> [junit4:junit4]   2> 7315 T90 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:44139/solr
> [junit4:junit4]   2> 7315 T90 oasc.ZkController.checkRecovery Core needs to recover:collection1
> [junit4:junit4]   2> 7315 T90 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
> [junit4:junit4]   2> ASYNC  NEW_CORE C2 name=collection1 org.apache.solr.core.SolrCore@14927a57 url=http://127.0.0.1:44139/solr/collection1 node=127.0.0.1:44139_solr
> [junit4:junit4]   2> 7318 T92 C2 P44139 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
> [junit4:junit4]   2> 7319 T90 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 7319 T92 C2 P44139 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
> [junit4:junit4]   2> 7320 T92 C2 P44139 oasc.ZkController.publish publishing core=collection1 state=recovering
> [junit4:junit4]   2> 7321 T92 C2 P44139 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4]   2> 7321 T19 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
> [junit4:junit4]   2> 7322 T19 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
> [junit4:junit4]   2> 7322 T19 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4]   2> 7322 T92 C2 P44139 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:45218/solr/collection1/ core=collection1 - recoveringAfterStartup=true
> [junit4:junit4]   2> 7326 T92 C2 P44139 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
> [junit4:junit4]   2> 7332 T92 C2 P44139 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:44139/solr START replicas=[http://127.0.0.1:45218/solr/collection1/] nUpdates=100
> [junit4:junit4]   2> 7335 T92 C2 P44139 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
> [junit4:junit4]   2> 7336 T92 C2 P44139 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
> [junit4:junit4]   2> 7336 T92 C2 P44139 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
> [junit4:junit4]   2> 7336 T92 C2 P44139 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4]   2> 7379 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 7381 T43 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
> [junit4:junit4]   2> 	  "operation":"state",
> [junit4:junit4]   2> 	  "numShards":"2",
> [junit4:junit4]   2> 	  "shard":"shard1",
> [junit4:junit4]   2> 	  "roles":null,
> [junit4:junit4]   2> 	  "state":"recovering",
> [junit4:junit4]   2> 	  "core":"collection1",
> [junit4:junit4]   2> 	  "collection":"collection1",
> [junit4:junit4]   2> 	  "node_name":"127.0.0.1:44139_solr",
> [junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:44139/solr"}
> [junit4:junit4]   2> 7387 T74 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
> [junit4:junit4]   2> 7387 T59 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
> [junit4:junit4]   2> 7387 T89 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
> [junit4:junit4]   2> 7387 T42 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
> [junit4:junit4]   2> 7389 T19 oejs.Server.doStart jetty-8.1.8.v20121106
> [junit4:junit4]   2> 7393 T19 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:52508
> [junit4:junit4]   2> 7394 T19 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
> [junit4:junit4]   2> 7394 T19 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355270180453
> [junit4:junit4]   2> 7395 T19 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355270180453/'
> [junit4:junit4]   2> 7412 T19 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
> [junit4:junit4]   2> 7413 T19 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
> [junit4:junit4]   2> 7413 T19 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355270180453
> [junit4:junit4]   2> 7414 T19 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355270180453/solr.xml
> [junit4:junit4]   2> 7414 T19 oasc.CoreContainer.<init> New CoreContainer 2085347999
> [junit4:junit4]   2> 7414 T19 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355270180453/'
> [junit4:junit4]   2> 7415 T19 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355270180453/'
> [junit4:junit4]   2> 7438 T19 oasc.CoreContainer.load Registering Log Listener
> [junit4:junit4]   2> 7452 T19 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:40680/solr
> [junit4:junit4]   2> 7452 T19 oasc.ZkController.checkChrootPath zkHost includes chroot
> [junit4:junit4]   2> 7453 T19 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:40680 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@4527769a
> [junit4:junit4]   2> 7455 T103 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:40680. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
> [junit4:junit4]   2> 7455 T19 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4]   2> 7456 T103 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:40680, initiating session
> [junit4:junit4]   2> 7456 T21 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:35889
> [junit4:junit4]   2> 7457 T21 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:35889
> [junit4:junit4]   2> 7458 T23 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8c65b223000a with negotiated timeout 20000 for client /127.0.0.1:35889
> [junit4:junit4]   2> 7458 T103 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:40680, sessionid = 0x13b8c65b223000a, negotiated timeout = 20000
> [junit4:junit4]   2> 7459 T104 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4527769a name:ZooKeeperConnection Watcher:127.0.0.1:40680 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4]   2> 7459 T19 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4]   2> 7462 T24 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b8c65b223000a
> [junit4:junit4]   2> 7463 T104 oaz.ClientCnxn$EventThread.run EventThread shut down
> [junit4:junit4]   2> 7464 T21 oazs.NIOServerCnxn.doIO WARNING caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13b8c65b223000a, likely client has closed socket
> [junit4:junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
> [junit4:junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
> [junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:722)
> [junit4:junit4]   2> 
> [junit4:junit4]   2> 7463 T19 oaz.ZooKeeper.close Session: 0x13b8c65b223000a closed
> [junit4:junit4]   2> 7468 T21 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:35889 which had sessionid 0x13b8c65b223000a
> [junit4:junit4]   2> 7468 T19 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:40680/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@478f6f48
> [junit4:junit4]   2> 7473 T105 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:40680. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
> [junit4:junit4]   2> 7474 T105 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:40680, initiating session
> [junit4:junit4]   2> 7474 T21 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:35890
> [junit4:junit4]   2> 7475 T21 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:35890
> [junit4:junit4]   2> 7476 T23 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8c65b223000b with negotiated timeout 8000 for client /127.0.0.1:35890
> [junit4:junit4]   2> 7476 T105 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:40680, sessionid = 0x13b8c65b223000b, negotiated timeout = 8000
> [junit4:junit4]   2> 7477 T19 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4]   2> 7478 T106 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@478f6f48 name:ZooKeeperConnection Watcher:127.0.0.1:40680/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4]   2> 7478 T19 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4]   2> 7480 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b223000b type:create cxid:0x1 zxid:0xa6 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 7481 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b223000b type:create cxid:0x2 zxid:0xa7 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 7483 T19 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52508_solr
> [junit4:junit4]   2> 7484 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b8c65b223000b type:delete cxid:0x4 zxid:0xa8 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:52508_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:52508_solr
> [junit4:junit4]   2> 7485 T19 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52508_solr
> [junit4:junit4]   2> 7489 T42 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
> [junit4:junit4]   2> 7489 T89 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
> [junit4:junit4]   2> 7489 T74 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
> [junit4:junit4]   2> 7496 T42 oascc.ZkStateReader$3.process Updating live nodes... (5)
> [junit4:junit4]   2> 7496 T89 oascc.ZkStateReader$3.process Updating live nodes... (5)
> [junit4:junit4]   2> 7497 T74 oascc.ZkStateReader$3.process Updating live nodes... (5)
> [junit4:junit4]   2> 7499 T19 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
> [junit4:junit4]   2> 7500 T19 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
> [junit4:junit4]   2> 7500 T59 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
> [junit4:junit4]   2> 7500 T19 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
> [junit4:junit4]   2> 7501 T19 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
> [junit4:junit4]   2> 7502 T19 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
> [junit4:junit4]   2> 7502 T19 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
> [junit4:junit4]   2> 7503 T19 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
> [junit4:junit4]   2> 7503 T19 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
> [junit4:junit4]   2> 7504 T19 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
> [junit4:junit4]   2> 7505 T19 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
> [junit4:junit4]   2> 7514 T59 oascc.ZkStateReader$3.process Updating live nodes... (5)
> [junit4:junit4]   2> 7522 T19 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
> [junit4:junit4]   2> 7531 T107 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355270180453/collection1
> [junit4:junit4]   2> 7531 T107 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
> [junit4:junit4]   2> 7533 T107 oasc.ZkController.createCollectionZkNode Collection zkNode exists
> [junit4:junit4]   2> 7533 T107 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
> [junit4:junit4]   2> 7535 T107 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355270180453/collection1/'
> [junit4:junit4]   2> 7536 T107 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty4-1355270180453/collection1/lib/README' to classloader
> [junit4:junit4]   2> 7537 T107 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-jetty4-1355270180453/collection1/lib/classes/' to classloader
> [junit4:junit4]   2> 7586 T107 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
> [junit4:junit4]   2> ASYNC  NEW_CORE C3 name=collection1 org.apache.solr.core.SolrCore@13eecd31 url=http://127.0.0.1:45218/solr/collection1 node=127.0.0.1:45218_solr
> [junit4:junit4]   2> 7618 T55 C3 P45218 REQ /get {distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=4 
> [junit4:junit4]   2> 7630 T107 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
> [junit4:junit4]   2> 7631 T107 oass.IndexSchema.readSchema Reading Solr Schema
> [junit4:junit4]   2> 7646 T107 oass.IndexSchema.readSchema Schema name=test
> [junit4:junit4]   2> 8003 T107 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
> [junit4:junit4]   2> 8012 T107 oass.IndexSchema.readSchema default search field in schema is text
> [junit4:junit4]   2> 8015 T107 oass.IndexSchema.readSchema unique key field: id
> [junit4:junit4]   2> 8044 T107 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4:junit4]   2> 8050 T107 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4:junit4]   2> 8057 T107 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4]   2> 8062 T107 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4]   2> 8066 T107 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-jetty4-1355270180453/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty4/
> [junit4:junit4]   2> 8066 T107 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bb8a8c6
> [junit4:junit4]   2> 8067 T107 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty4/index/
> [junit4:junit4]   2> 8068 T107 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty4/index' doesn't exist. Creating new index...
> [junit4:junit4]   2> 8069 T107 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty4/index forceNew:false
> [junit4:junit4]   2> 8073 T107 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
> [junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@36d5ee2; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
> [junit4:junit4]   2> 8074 T107 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
> [junit4:junit4]   2> 8074 T107 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
> [junit4:junit4]   2> 8077 T107 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
> [junit4:junit4]   2> 8078 T107 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
> [junit4:junit4]   2> 8078 T107 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
> [junit4:junit4]   2> 8078 T107 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
> [junit4:junit4]   2> 8079 T107 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
> [junit4:junit4]   2> 8079 T107 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
> [junit4:junit4]   2> 8080 T107 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
> [junit4:junit4]   2> 8081 T107 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
> [junit4:junit4]   2> 8082 T107 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
> [junit4:junit4]   2> 8083 T107 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
> [junit4:junit4]   2> 8084 T107 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
> [junit4:junit4]   2> 8085 T107 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
> [junit4:junit4]   2> 8086 T107 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
> [junit4:junit4]   2> 8086 T107 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
> [junit4:junit4]   2> 8087 T107 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
> [junit4:junit4]   2> 8088 T107 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
> [junit4:junit4]   2> 8089 T107 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 8090 T107 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 8091 T107 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 8093 T107 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 8094 T107 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 8096 T107 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 8097 T107 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 8098 T107 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
> [junit4:junit4]   2> 8099 T107 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
> [junit4:junit4]   2> 8102 T107 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
> [junit4:junit4]   2> 8104 T107 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
> [junit4:junit4]   2> 8110 T107 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
> [junit4:junit4]   2> 8114 T107 oass.SolrIndexSearcher.<init> Opening Searcher@7ff1bfd0 main
> [junit4:junit4]   2> 8114 T107 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
> [junit4:junit4]   2> 8115 T107 oasu.CommitTracker.<init> Hard AutoCommit: disabled
> [junit4:junit4]   2> 8116 T107 oasu.CommitTracker.<init> Soft AutoCommit: disabled
> [junit4:junit4]   2> 8117 T107 oashc.SpellCheckComponent.inform Initializing spell checkers
> [junit4:junit4]   2> 8122 T107 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
> [junit4:junit4]   2> 8159 T108 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7ff1bfd0 main{StandardDirectoryReader(segments_1:1)}
> [junit4:junit4]   2> 8179 T107 oasc.ZkController.publish publishing core=collection1 state=down
> [junit4:junit4]   2> 8179 T107 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4]   2> 8397 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 8399 T43 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
> [junit4:junit4]   2> 	  "operation":"state",
> [junit4:junit4]   2> 	  "numShards":"2",
> [junit4:junit4]   2> 	  "shard":null,
> [junit4:junit4]   2> 	  "roles":null,
> [junit4:junit4]   2> 	  "state":"down",
> [junit4:junit4]   2> 	  "core":"collection1",
> [junit4:junit4]   2> 	  "collection":"collection1",
> [junit4:junit4]   2> 	  "node_name":"127.0.0.1:52508_solr",
> [junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:52508/solr"}
> [junit4:junit4]   2> 8399 T43 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
> [junit4:junit4]   2> 8399 T43 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
> [junit4:junit4]   2> 8406 T74 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
> [junit4:junit4]   2> 8406 T89 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
> [junit4:junit4]   2> 8406 T42 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
> [junit4:junit4]   2> 8406 T59 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
> [junit4:junit4]   2> 8406 T106 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
> [junit4:junit4]   2> 8682 T107 oasc.CoreContainer.register registering core: collection1
> [junit4:junit4]   2> 8682 T107 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:52508/solr shardId:shard2
> [junit4:junit4]   2> 8687 T107 oasc.ZkController.register We are http://127.0.0.1:52508/solr/collection1/ and leader is http://127.0.0.1:38136/solr/collection1/
> [junit4:junit4]   2> 8687 T107 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:52508/solr
> [junit4:junit4]   2> 8687 T107 oasc.ZkController.checkRecovery Core needs to recover:collection1
> [junit4:junit4]   2> 8687 T107 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
> [junit4:junit4]   2> ASYNC  NEW_CORE C4 name=collection1 org.apache.solr.core.SolrCore@159e752 url=http://127.0.0.1:52508/solr/collection1 node=127.0.0.1:52508_solr
> [junit4:junit4]   2> 8688 T109 C4 P52508 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
> [junit4:junit4]   2> 8689 T109 C4 P52508 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
> [junit4:junit4]   2> 8689 T107 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 8689 T109 C4 P52508 oasc.ZkController.publish publishing core=collection1 state=recovering
> [junit4:junit4]   2> 8689 T109 C4 P52508 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4]   2> 8690 T19 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
> [junit4:junit4]   2> 8691 T109 C4 P52508 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:38136/solr/collection1/ core=collection1 - recoveringAfterStartup=true
> [junit4:junit4]   2> 8691 T19 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
> [junit4:junit4]   2> 8691 T109 C4 P52508 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:52508/solr START replicas=[http://127.0.0.1:38136/solr/collection1/] nUpdates=100
> [junit4:junit4]   2> 8692 T19 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4]   2> 8692 T109 C4 P52508 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
> [junit4:junit4]   2> 8692 T109 C4 P52508 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
> [junit4:junit4]   2> 8693 T109 C4 P52508 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
> [junit4:junit4]   2> 8693 T109 C4 P52508 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4]   2> ASYNC  NEW_CORE C5 name=collection1 org.apache.solr.core.SolrCore@6cb9b841 url=http://127.0.0.1:38136/solr/collection1 node=127.0.0.1:38136_solr
> [junit4:junit4]   2> 8700 T67 C5 P38136 REQ /get {distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=0 
> [junit4:junit4]   2> 8702 T19 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:40680/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@220d53c
> [junit4:junit4]   2> 8703 T19 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4]   2> 8703 T111 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:40680. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
> [junit4:junit4]   2> 8704 T111 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:40680, initiating session
> [junit4:junit4]   2> 8704 T21 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:35895
> [junit4:junit4]   2> 8705 T21 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:35895
> [junit4:junit4]   2> 8706 T23 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8c65b223000c with negotiated timeout 10000 for client /127.0.0.1:35895
> [junit4:junit4]   2> 8706 T111 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:40680, sessionid = 0x13b8c65b223000c, negotiated timeout = 10000
> [junit4:junit4]   2> 8707 T112 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@220d53c name:ZooKeeperConnection Watcher:127.0.0.1:40680/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4]   2> 8707 T19 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4]   2> 8708 T19 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
> [junit4:junit4]   2> 8713 T19 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
> [junit4:junit4]   2> 8714 T19 oascsi.HttpClientUtil.createClient Creating new http client, config:
> [junit4:junit4]   2> 8719 T19 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 8722 T19 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):540
> [junit4:junit4]   2> 8723 T19 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 8913 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 8915 T43 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
> [junit4:junit4]   2> 	  "operation":"state",
> [junit4:junit4]   2> 	  "numShards":"2",
> [junit4:junit4]   2> 	  "shard":"shard2",
> [junit4:junit4]   2> 	  "roles":null,
> [junit4:junit4]   2> 	  "state":"recovering",
> [junit4:junit4]   2> 	  "core":"collection1",
> [junit4:junit4]   2> 	  "collection":"collection1",
> [junit4:junit4]   2> 	  "node_name":"127.0.0.1:52508_solr",
> [junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:52508/solr"}
> [junit4:junit4]   2> 8941 T74 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
> [junit4:junit4]   2> 8941 T106 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
> [junit4:junit4]   2> 8941 T112 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
> [junit4:junit4]   2> 8941 T59 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
> [junit4:junit4]   2> 8942 T42 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
> [junit4:junit4]   2> 8941 T89 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
> [junit4:junit4]   2>  C2_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:44139_solr, base_url=http://127.0.0.1:44139/solr}
> [junit4:junit4]   2> 9654 T92 C2 P44139 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
> [junit4:junit4]   2> 9655 T92 C2 P44139 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
> [junit4:junit4]   2> 9655 T92 C2 P44139 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:45218/solr/collection1/. core=collection1
> [junit4:junit4]   2> 9655 T92 C2 P44139 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4]   2> 9667 T53 C3 P45218 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16
> [junit4:junit4]   2> 9671 T53 C3 P45218 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
> [junit4:junit4]   2> 9674 T53 C3 P45218 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
> [junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@28f1d4e2; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
> [junit4:junit4]   2> 9674 T53 C3 P45218 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
> [junit4:junit4]   2> 9726 T19 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 9756 T53 C3 P45218 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
> [junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@28f1d4e2; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
> [junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@28f1d4e2; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
> [junit4:junit4]   2> 9756 T53 C3 P45218 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
> [junit4:junit4]   2> 9757 T53 C3 P45218 oass.SolrIndexSearcher.<init> Opening Searcher@500d68b realtime
> [junit4:junit4]   2> 9758 T53 C3 P45218 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
> [junit4:junit4]   2> 9758 T53 C3 P45218 oasu.DirectUpdateHandler2.commit end_commit_flush
> [junit4:junit4]   2> 9759 T53 C3 P45218 /update {waitSearcher=true&openSearcher=false&commit=true&commit_end_point=true&wt=javabin&softCommit=false&version=2} {commit=} 0 94
> [junit4:junit4]   2> 9774 T92 C2 P44139 oash.ReplicationHandler.inform Commits will be reserved for  10000
> [junit4:junit4]   2> 9775 T92 C2 P44139 oascsi.HttpClientUtil.createClient Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
> [junit4:junit4]   2> 9780 T92 C2 P44139 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
> [junit4:junit4]   2> 9794 T55 C3 P45218 oash.ReplicationHandler.inform Commits will be reserved for  10000
> [junit4:junit4]   2> 9794 T55 C3 P45218 REQ /replication {command=indexversion&wt=javabin&qt=/replication&version=2} status=0 QTime=12 
> [junit4:junit4]   2> 9796 T92 C2 P44139 oash.SnapPuller.fetchLatestIndex Master's generation: 2
> [junit4:junit4]   2> 9796 T92 C2 P44139 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
> [junit4:junit4]   2> 9796 T92 C2 P44139 oash.SnapPuller.fetchLatestIndex Starting replication process
> [junit4:junit4]   2> 9800 T53 C3 P45218 REQ /replication {command=filelist&generation=2&wt=javabin&qt=/replication&version=2} status=0 QTime=1 
> [junit4:junit4]   2> 9801 T92 C2 P44139 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
> [junit4:junit4]   2> 9802 T92 C2 P44139 oash.SnapPuller.fetchLatestIndex Starting download to ./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty3/index.20121211195622927 fullCopy=true
> [junit4:junit4]   2> 9807 T52 C3 P45218 REQ /replication {file=segments_2&command=filecontent&checksum=true&generation=2&qt=/replication&wt=filestream} status=0 QTime=1 
> [junit4:junit4]   2> 9812 T92 C2 P44139 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
> [junit4:junit4]   2> 9816 T92 C2 P44139 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20121211195622927
> [junit4:junit4]   2> 9821 T92 C2 P44139 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty3/index/ new=./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty3/index.20121211195622927
> [junit4:junit4]   2> 9822 T92 C2 P44139 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty3/index.20121211195622927 forceNew:false
> [junit4:junit4]   2> 9824 T92 C2 P44139 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
> [junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty3/index.20121211195622927 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3290dd1b; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
> [junit4:junit4]   2> 9825 T92 C2 P44139 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
> [junit4:junit4]   2> 9827 T92 C2 P44139 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
> [junit4:junit4]   2> 9827 T92 C2 P44139 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
> [junit4:junit4]   2> 9827 T92 C2 P44139 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
> [junit4:junit4]   2> 9828 T92 C2 P44139 oasc.CachingDirectoryFactory.close Closing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty3/index.20121211195622927
> [junit4:junit4]   2> 9829 T92 C2 P44139 oash.SnapPuller$2.onClose removing old index directory ./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty3/index
> [junit4:junit4]   2> 9830 T92 C2 P44139 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty3/index.20121211195622927 forceNew:true
> [junit4:junit4]   2> 9832 T92 C2 P44139 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
> [junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty3/index.20121211195622927 lockFactory=org.apache.lucene.store.NativeFSLockFactory@40fc2376; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
> [junit4:junit4]   2> 9832 T92 C2 P44139 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
> [junit4:junit4]   2> 9832 T92 C2 P44139 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
> [junit4:junit4]   2> 9833 T92 C2 P44139 oass.SolrIndexSearcher.<init> Opening Searcher@5a9665fc main
> [junit4:junit4]   2> 9833 T92 C2 P44139 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
> [junit4:junit4]   2> 9836 T91 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5a9665fc main{StandardDirectoryReader(segments_2:1:nrt)}
> [junit4:junit4]   2> 9837 T92 C2 P44139 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
> [junit4:junit4]   2> 9857 T92 C2 P44139 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
> [junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty3/index.20121211195622927 lockFactory=org.apache.lucene.store.NativeFSLockFactory@40fc2376; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
> [junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty3/index.20121211195622927 lockFactory=org.apache.lucene.store.NativeFSLockFactory@40fc2376; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
> [junit4:junit4]   2> 9858 T92 C2 P44139 oasc.SolrDeletionPolicy.updateCommits newest commit = 3
> [junit4:junit4]   2> 9858 T92 C2 P44139 oasu.DirectUpdateHandler2.commit end_commit_flush
> [junit4:junit4]   2> 9859 T92 C2 P44139 oasc.RecoveryStrategy.replay No replay needed. core=collection1
> [junit4:junit4]   2> 9859 T92 C2 P44139 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
> [junit4:junit4]   2> 9859 T92 C2 P44139 oasc.ZkController.publish publishing core=collection1 state=active
> [junit4:junit4]   2> 9859 T92 C2 P44139 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4]   2> 9861 T92 C2 P44139 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
> [junit4:junit4]   2> 9952 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 9954 T43 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
> [junit4:junit4]   2> 	  "operation":"state",
> [junit4:junit4]   2> 	  "numShards":"2",
> [junit4:junit4]   2> 	  "shard":"shard1",
> [junit4:junit4]   2> 	  "roles":null,
> [junit4:junit4]   2> 	  "state":"active",
> [junit4:junit4]   2> 	  "core":"collection1",
> [junit4:junit4]   2> 	  "collection":"collection1",
> [junit4:junit4]   2> 	  "node_name":"127.0.0.1:44139_solr",
> [junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:44139/solr"}
> [junit4:junit4]   2> 9986 T112 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
> [junit4:junit4]   2> 9986 T74 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
> [junit4:junit4]   2> 9987 T106 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
> [junit4:junit4]   2> 9987 T42 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
> [junit4:junit4]   2> 9986 T89 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
> [junit4:junit4]   2> 9987 T59 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
> [junit4:junit4]   2> 10728 T19 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2>  C4_STATE=coll:collection1 core:collection1 props:{shard=shard2, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:52508_solr, base_url=http://127.0.0.1:52508/solr}
> [junit4:junit4]   2> 11706 T109 C4 P52508 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
> [junit4:junit4]   2> 11707 T109 C4 P52508 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
> [junit4:junit4]   2> 11707 T109 C4 P52508 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:38136/solr/collection1/. core=collection1
> [junit4:junit4]   2> 11707 T109 C4 P52508 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4]   2> 11718 T69 C5 P38136 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
> [junit4:junit4]   2> 11721 T69 C5 P38136 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
> [junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3b63ecdd; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
> [junit4:junit4]   2> 11722 T69 C5 P38136 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
> [junit4:junit4]   2> 11731 T19 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 11766 T69 C5 P38136 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
> [junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3b63ecdd; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
> [junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3b63ecdd; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
> [junit4:junit4]   2> 11766 T69 C5 P38136 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
> [junit4:junit4]   2> 11767 T69 C5 P38136 oass.SolrIndexSearcher.<init> Opening Searcher@14446bce realtime
> [junit4:junit4]   2> 11767 T69 C5 P38136 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
> [junit4:junit4]   2> 11768 T69 C5 P38136 oasu.DirectUpdateHandler2.commit end_commit_flush
> [junit4:junit4]   2> 11768 T69 C5 P38136 /update {waitSearcher=true&openSearcher=false&commit=true&commit_end_point=true&wt=javabin&softCommit=false&version=2} {commit=} 0 51
> [junit4:junit4]   2> 11770 T109 C4 P52508 oash.ReplicationHandler.inform Commits will be reserved for  10000
> [junit4:junit4]   2> 11771 T109 C4 P52508 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
> [junit4:junit4]   2> 11774 T67 C5 P38136 oash.ReplicationHandler.inform Commits will be reserved for  10000
> [junit4:junit4]   2> 11775 T67 C5 P38136 REQ /replication {command=indexversion&wt=javabin&qt=/replication&version=2} status=0 QTime=2 
> [junit4:junit4]   2> 11776 T109 C4 P52508 oash.SnapPuller.fetchLatestIndex Master's generation: 2
> [junit4:junit4]   2> 11776 T109 C4 P52508 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
> [junit4:junit4]   2> 11776 T109 C4 P52508 oash.SnapPuller.fetchLatestIndex Starting replication process
> [junit4:junit4]   2> 11779 T68 C5 P38136 REQ /replication {command=filelist&generation=2&wt=javabin&qt=/replication&version=2} status=0 QTime=0 
> [junit4:junit4]   2> 11780 T109 C4 P52508 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
> [junit4:junit4]   2> 11781 T109 C4 P52508 oash.SnapPuller.fetchLatestIndex Starting download to ./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty4/index.20121211195624907 fullCopy=true
> [junit4:junit4]   2> 11786 T69 C5 P38136 REQ /replication {file=segments_2&command=filecontent&checksum=true&generation=2&qt=/replication&wt=filestream} status=0 QTime=0 
> [junit4:junit4]   2> 11792 T109 C4 P52508 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
> [junit4:junit4]   2> 11796 T109 C4 P52508 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20121211195624907
> [junit4:junit4]   2> 11797 T109 C4 P52508 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty4/index/ new=./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty4/index.20121211195624907
> [junit4:junit4]   2> 11798 T109 C4 P52508 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty4/index.20121211195624907 forceNew:false
> [junit4:junit4]   2> 11800 T109 C4 P52508 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
> [junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty4/index.20121211195624907 lockFactory=org.apache.lucene.store.NativeFSLockFactory@194206c9; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
> [junit4:junit4]   2> 11801 T109 C4 P52508 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
> [junit4:junit4]   2> 11802 T109 C4 P52508 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
> [junit4:junit4]   2> 11802 T109 C4 P52508 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
> [junit4:junit4]   2> 11803 T109 C4 P52508 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
> [junit4:junit4]   2> 11803 T109 C4 P52508 oasc.CachingDirectoryFactory.close Closing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty4/index.20121211195624907
> [junit4:junit4]   2> 11804 T109 C4 P52508 oash.SnapPuller$2.onClose removing old index directory ./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty4/index
> [junit4:junit4]   2> 11805 T109 C4 P52508 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty4/index.20121211195624907 forceNew:true
> [junit4:junit4]   2> 11808 T109 C4 P52508 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
> [junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty4/index.20121211195624907 lockFactory=org.apache.lucene.store.NativeFSLockFactory@444f0429; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
> [junit4:junit4]   2> 11808 T109 C4 P52508 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
> [junit4:junit4]   2> 11808 T109 C4 P52508 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
> [junit4:junit4]   2> 11809 T109 C4 P52508 oass.SolrIndexSearcher.<init> Opening Searcher@489668ad main
> [junit4:junit4]   2> 11809 T109 C4 P52508 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
> [junit4:junit4]   2> 11812 T108 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@489668ad main{StandardDirectoryReader(segments_2:1:nrt)}
> [junit4:junit4]   2> 11813 T109 C4 P52508 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
> [junit4:junit4]   2> 11827 T109 C4 P52508 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
> [junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty4/index.20121211195624907 lockFactory=org.apache.lucene.store.NativeFSLockFactory@444f0429; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
> [junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/jetty4/index.20121211195624907 lockFactory=org.apache.lucene.store.NativeFSLockFactory@444f0429; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
> [junit4:junit4]   2> 11829 T109 C4 P52508 oasc.SolrDeletionPolicy.updateCommits newest commit = 3
> [junit4:junit4]   2> 11830 T109 C4 P52508 oasu.DirectUpdateHandler2.commit end_commit_flush
> [junit4:junit4]   2> 11830 T109 C4 P52508 oasc.RecoveryStrategy.replay No replay needed. core=collection1
> [junit4:junit4]   2> 11830 T109 C4 P52508 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
> [junit4:junit4]   2> 11830 T109 C4 P52508 oasc.ZkController.publish publishing core=collection1 state=active
> [junit4:junit4]   2> 11831 T109 C4 P52508 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4]   2> 11832 T109 C4 P52508 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
> [junit4:junit4]   2> 12005 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 12006 T43 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
> [junit4:junit4]   2> 	  "operation":"state",
> [junit4:junit4]   2> 	  "numShards":"2",
> [junit4:junit4]   2> 	  "shard":"shard2",
> [junit4:junit4]   2> 	  "roles":null,
> [junit4:junit4]   2> 	  "state":"active",
> [junit4:junit4]   2> 	  "core":"collection1",
> [junit4:junit4]   2> 	  "collection":"collection1",
> [junit4:junit4]   2> 	  "node_name":"127.0.0.1:52508_solr",
> [junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:52508/solr"}
> [junit4:junit4]   2> 12011 T112 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
> [junit4:junit4]   2> 12011 T42 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
> [junit4:junit4]   2> 12011 T59 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
> [junit4:junit4]   2> 12011 T74 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
> [junit4:junit4]   2> 12011 T89 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
> [junit4:junit4]   2> 12011 T106 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
> [junit4:junit4]   2> 12735 T19 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> ASYNC  NEW_CORE C6 name=collection1 org.apache.solr.core.SolrCore@595188bf url=http://127.0.0.1:40765/solr/collection1 node=127.0.0.1:40765_solr
> [junit4:junit4]   2> 12770 T36 C6 P40765 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
> [junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1355270173136/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1d85813a; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
> [junit4:junit4]   2> 12771 T36 C6 P40765 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
> [junit4:junit4]   2> 12778 T36 C6 P40765 oass.SolrIndexSearcher.<init> Opening Searcher@6dd28655 realtime
> [junit4:junit4]   2> 12779 T36 C6 P40765 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.RateLimitedDirectoryWrapper
> [junit4:junit4]   2> 12780 T36 C6 P40765 /update {wt=javabin&version=2} {deleteByQuery=*:* (-1421103790437695488)} 0 25
> [junit4:junit4]   2> 12781 T19 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:40680/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@3f1fd75a
> [junit4:junit4]   2> 12782 T19 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4]   2> 12782 T115 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:40680. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
> [junit4:junit4]   2> 12782 T115 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:40680, initiating session
> [junit4:junit4]   2> 12783 T21 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:35913
> [junit4:junit4]   2> 12783 T21 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:35913
> [junit4:junit4]   2> 12784 T23 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b8c65b223000d with negotiated timeout 10000 for client /127.0.0.1:35913
> [junit4:junit4]   2> 12784 T115 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:40680, sessionid = 0x13b8c65b223000d, negotiated timeout = 10000
> [junit4:junit4]   2> 12785 T116 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3f1fd75a name:ZooKeeperConnection Watcher:127.0.0.1:40680/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4]   2> 12785 T19 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4]   2> 12786 T19 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
> [junit4:junit4]   2>  C2_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:44139_solr, base_url=http://127.0.0.1:44139/solr}
> [junit4:junit4]   2> 12809 T83 C2 P44139 REQ /update {update.distrib=FROMLEADER&_version_=-1421103790471249920&update.from=http://127.0.0.1:45218/solr/collection1/&wt=javabin&version=2} status=0 QTime=2 
> [junit4:junit4]   2>  C4_STATE=coll:collection1 core:collection1 props:{shard=shard2, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:52508_solr, base_url=http://127.0.0.1:52508/solr}
> [junit4:junit4]   2> 12811 T102 C4 P52508 REQ /update {update.distrib=FROMLEADER&_version_=-1421103790481735680&update.from=htt
> 
> [...truncated too long message...]
> 
> ting.SeedInfo.seed([A672C1073219D55D:27944F1F4546B561]:0)
> [junit4:junit4]    > 	at org.junit.Assert.fail(Assert.java:93)
> [junit4:junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:165)
> [junit4:junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:115)
> [junit4:junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:110)
> [junit4:junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:563)
> [junit4:junit4]    > 	at org.apache.solr.cloud.BasicDistributedZk2Test.brindDownShardIndexSomeDocsAndRecover(BasicDistributedZk2Test.java:321)
> [junit4:junit4]    > 	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:83)
> [junit4:junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:697)
> [junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> [junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> [junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> [junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:601)
> [junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
> [junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
> [junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
> [junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
> [junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
> [junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
> [junit4:junit4]    > 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
> [junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
> [junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> [junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> [junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
> [junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> [junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> [junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> [junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> [junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
> [junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
> [junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
> [junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
> [junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
> [junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
> [junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> [junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
> [junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> [junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
> [junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> [junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> [junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> [junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> [junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
> [junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> [junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> [junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
> [junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> [junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> [junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:722)
> [junit4:junit4]   2> 567393 T1974 oas.SolrTestCaseJ4.deleteCore ###deleteCore
> [junit4:junit4]   2> NOTE: test params are: codec=FastDecompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST_DECOMPRESSION, chunkSize=12)), sim=RandomSimilarityProvider(queryNorm=false,coord=yes): {}, locale=is, timezone=America/La_Paz
> [junit4:junit4]   2> NOTE: Linux 3.2.0-34-generic amd64/Oracle Corporation 1.7.0_09 (64-bit)/cpus=8,threads=2,free=94272064,total=434110464
> [junit4:junit4]   2> NOTE: All tests run in this JVM: [HighlighterConfigTest, SpellCheckCollatorTest, BasicDistributedZkTest, SpellCheckComponentTest, CopyFieldTest, PreAnalyzedFieldTest, TestExtendedDismaxParser, TestLFUCache, TestDefaultSimilarityFactory, WordBreakSolrSpellCheckerTest, TestAnalyzedSuggestions, TestLuceneMatchVersion, DistributedSpellCheckComponentTest, SpellPossibilityIteratorTest, TestLMJelinekMercerSimilarityFactory, JsonLoaderTest, MBeansHandlerTest, TestIndexingPerformance, AnalysisAfterCoreReloadTest, TestQueryTypes, TestBadConfig, TestWordDelimiterFilterFactory, SystemInfoHandlerTest, TestXIncludeConfig, TestFastOutputStream, NumericFieldsTest, TestElisionMultitermQuery, TermsComponentTest, ZkControllerTest, TestConfig, MinimalSchemaTest, MoreLikeThisHandlerTest, TestSystemIdResolver, TestFaceting, TestGroupingSearch, TestFastWriter, NotRequiredUniqueKeyTest, SimpleFacetsTest, TestSearchPerf, IndexBasedSpellCheckerTest, TestPerFieldSimilarity, TestQuerySenderNoQuery, PluginInfoTest, CircularListTest, TestStressReorder, SimplePostToolTest, BadComponentTest, SuggesterFSTTest, TestPHPSerializedResponseWriter, FieldAnalysisRequestHandlerTest, SuggesterWFSTTest, TestBinaryResponseWriter, SearchHandlerTest, AlternateDirectoryTest, TestJmxMonitoredMap, TestRealTimeGet, TestDistributedSearch, SoftAutoCommitTest, AutoCommitTest, ZkSolrClientTest, TestHashPartitioner, StatsComponentTest, TestRecovery, SolrCoreTest, TestRangeQuery, DirectUpdateHandlerTest, TestCoreContainer, TestSort, DirectSolrSpellCheckerTest, TestFiltering, FileBasedSpellCheckerTest, ConvertedLegacyTest, PeerSyncTest, QueryElevationComponentTest, SortByFunctionTest, SignatureUpdateProcessorFactoryTest, TestJmxIntegration, TestFunctionQuery, QueryEqualityTest, TestCSVResponseWriter, TestPseudoReturnFields, IndexSchemaTest, QueryParsingTest, PingRequestHandlerTest, TermVectorComponentTest, DocumentAnalysisRequestHandlerTest, IndexSchemaRuntimeFieldTest, SolrPluginUtilsTest, FastVectorHighlighterTest, TestReversedWildcardFilterFactory, TestOmitPositions, TestQueryUtils, LoggingHandlerTest, SolrCmdDistributorTest, CSVRequestHandlerTest, BadIndexSchemaTest, UpdateRequestProcessorFactoryTest, PrimitiveFieldTypeTest, SOLR749Test, DefaultValueUpdateProcessorTest, SolrIndexConfigTest, TestLMDirichletSimilarityFactory, TestCodecSupport, TestFastLRUCache, URLClassifyProcessorTest, FileUtilsTest, TestSuggestSpellingConverter, RAMDirectoryFactoryTest, TestDocumentBuilder, BasicDistributedZk2Test]
> [junit4:junit4] Completed on J0 in 567.41s, 1 test, 1 failure <<< FAILURES!
> 
> [...truncated 11 lines...]
> BUILD FAILED
> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:352: The following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:178: The following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:438: The following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1171: The following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:835: There were test failures: 239 suites, 994 tests, 1 error, 1 failure, 7 ignored (2 assumptions)
> 
> Total time: 32 minutes 46 seconds
> Build step 'Invoke Ant' marked build as failure
> Archiving artifacts
> Recording test results
> Description set: Java: 64bit/jdk1.7.0_09 -XX:+UseParallelGC
> Email was triggered for: Failure
> Sending email for trigger: Failure
> 
> 
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org