You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2013/03/21 12:39:44 UTC

[JENKINS] Lucene-Solr-Tests-4.x-java7 - Build # 1087 - Failure

Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-java7/1087/

2 tests failed.
REGRESSION:  org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.testDistribSearch

Error Message:
shard3 is not consistent.  Got 13 from http://127.0.0.1:18886/pc_kzu/vk/collection1lastClient and got 0 from http://127.0.0.1:18917/pc_kzu/vk/collection1

Stack Trace:
java.lang.AssertionError: shard3 is not consistent.  Got 13 from http://127.0.0.1:18886/pc_kzu/vk/collection1lastClient and got 0 from http://127.0.0.1:18917/pc_kzu/vk/collection1
	at __randomizedtesting.SeedInfo.seed([8ABE485330C4961E:B58C64B479BF622]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:963)
	at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.doTest(ChaosMonkeySafeLeaderTest.java:137)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:601)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)


REGRESSION:  org.apache.solr.cloud.SyncSliceTest.testDistribSearch

Error Message:
Test Setup Failure: shard1 should have just been set up to be inconsistent - but it's still consistent. Leader:http://127.0.0.1:44916/b/rt/collection1 Dead Guy:http://127.0.0.1:44912/b/rt/collection1skip list:[CloudJettyRunner [url=http://127.0.0.1:44927/b/rt/collection1], CloudJettyRunner [url=http://127.0.0.1:44927/b/rt/collection1]]

Stack Trace:
java.lang.AssertionError: Test Setup Failure: shard1 should have just been set up to be inconsistent - but it's still consistent. Leader:http://127.0.0.1:44916/b/rt/collection1 Dead Guy:http://127.0.0.1:44912/b/rt/collection1skip list:[CloudJettyRunner [url=http://127.0.0.1:44927/b/rt/collection1], CloudJettyRunner [url=http://127.0.0.1:44927/b/rt/collection1]]
	at __randomizedtesting.SeedInfo.seed([8ABE485330C4961E:B58C64B479BF622]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNotNull(Assert.java:526)
	at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:212)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:601)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)




Build Log:
[...truncated 8955 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
[junit4:junit4]   2> 0 T23 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /pc_kzu/vk
[junit4:junit4]   2> 18 T23 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./solrtest-ChaosMonkeySafeLeaderTest-1363864687969
[junit4:junit4]   2> 25 T23 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 31 T24 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 94 T24 oaz.Environment.logEnv Server environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
[junit4:junit4]   2> 94 T24 oaz.Environment.logEnv Server environment:host.name=lucene.zones.apache.org
[junit4:junit4]   2> 94 T24 oaz.Environment.logEnv Server environment:java.version=1.7.0_17
[junit4:junit4]   2> 95 T24 oaz.Environment.logEnv Server environment:java.vendor=Oracle Corporation
[junit4:junit4]   2> 95 T24 oaz.Environment.logEnv Server environment:java.home=/usr/local/openjdk7/jre
[junit4:junit4]   2> 95 T24 oaz.Environment.logEnv Server environment:java.class.path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/classes/test:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-test-framework/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/build/test-framework/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/build/codecs/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-solrj/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/build/analysis/common/lucene-analyzers-common-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/build/codecs/lucene-codecs-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/build/highlighter/lucene-highlighter-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/build/memory/lucene-memory-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/build/misc/lucene-misc-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/build/spatial/lucene-spatial-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/build/suggest/lucene-suggest-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/build/grouping/lucene-grouping-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/build/queries/lucene-queries-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/build/queryparser/lucene-queryparser-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/core/lib/cglib-nodep-2.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/core/lib/commons-cli-1.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/core/lib/commons-codec-1.7.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/core/lib/commons-fileupload-1.2.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/core/lib/commons-lang-2.6.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/core/lib/easymock-3.0.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/core/lib/guava-13.0.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/core/lib/javax.servlet-api-3.0.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/core/lib/objenesis-1.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/core/lib/org.restlet-2.1.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/core/lib/org.restlet.ext.servlet-2.1.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/core/lib/spatial4j-0.3.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/solrj/lib/commons-io-2.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/solrj/lib/httpclient-4.2.3.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/solrj/lib/httpcore-4.2.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/solrj/lib/httpmime-4.2.3.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/solrj/lib/jcl-over-slf4j-1.6.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/solrj/lib/noggit-0.5.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/solrj/lib/slf4j-api-1.6.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/solrj/lib/slf4j-jdk14-1.6.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/solrj/lib/wstx-asl-3.2.7.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/solrj/lib/zookeeper-3.4.5.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/example/lib/jetty-continuation-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/example/lib/jetty-deploy-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/example/lib/jetty-http-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/example/lib/jetty-io-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/example/lib/jetty-jmx-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/example/lib/jetty-security-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/example/lib/jetty-server-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/example/lib/jetty-servlet-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/example/lib/jetty-util-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/example/lib/jetty-webapp-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/example/lib/jetty-xml-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/example/lib/servlet-api-3.0.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/example/example-DIH/solr/db/lib/hsqldb-1.8.0.10.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/build/core/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/test-framework/lib/junit-4.10.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/test-framework/lib/randomizedtesting-runner-2.0.8.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-launcher.jar:/home/hudson/.ant/lib/ivy-2.2.0.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-logging.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-regexp.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-oro.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-swing.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jdepend.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-xalan2.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bsf.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit4.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-net.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-antlr.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jmf.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-netrexx.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-log4j.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-resolver.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jsch.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-testutil.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bcel.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jai.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-javamail.jar:/usr/local/openjdk7/lib/tools.jar:/home/hudson/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.0.8.jar
[junit4:junit4]   2> 97 T24 oaz.Environment.logEnv Server environment:java.library.path=/usr/local/openjdk7/jre/lib/amd64/server:/usr/local/openjdk7/jre/lib/amd64:/usr/local/openjdk7/jre/../lib/amd64:/usr/local/openjdk6/jre/lib/amd64/server:/usr/local/openjdk6/jre/lib/amd64:/usr/local/openjdk6/jre/../lib/amd64:/usr/java/packages/lib/amd64:/lib:/usr/lib:/usr/local/lib
[junit4:junit4]   2> 97 T24 oaz.Environment.logEnv Server environment:java.io.tmpdir=.
[junit4:junit4]   2> 97 T24 oaz.Environment.logEnv Server environment:java.compiler=<NA>
[junit4:junit4]   2> 97 T24 oaz.Environment.logEnv Server environment:os.name=FreeBSD
[junit4:junit4]   2> 98 T24 oaz.Environment.logEnv Server environment:os.arch=amd64
[junit4:junit4]   2> 98 T24 oaz.Environment.logEnv Server environment:os.version=9.0-RELEASE
[junit4:junit4]   2> 98 T24 oaz.Environment.logEnv Server environment:user.name=hudson
[junit4:junit4]   2> 98 T24 oaz.Environment.logEnv Server environment:user.home=/home/hudson
[junit4:junit4]   2> 99 T24 oaz.Environment.logEnv Server environment:user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1
[junit4:junit4]   2> 136 T24 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 137 T24 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4]   2> 137 T24 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4]   2> 144 T24 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 232 T23 oasc.ZkTestServer.run start zk server on port:58321
[junit4:junit4]   2> 239 T24 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363864687968/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4]   2> 329 T23 oaz.Environment.logEnv Client environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
[junit4:junit4]   2> 330 T23 oaz.Environment.logEnv Client environment:host.name=lucene.zones.apache.org
[junit4:junit4]   2> 331 T23 oaz.Environment.logEnv Client environment:java.version=1.7.0_17
[junit4:junit4]   2> 331 T23 oaz.Environment.logEnv Client environment:java.vendor=Oracle Corporation
[junit4:junit4]   2> 332 T23 oaz.Environment.logEnv Client environment:java.home=/usr/local/openjdk7/jre
[junit4:junit4]   2> 333 T23 oaz.Environment.logEnv Client environment:java.class.path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/classes/test:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-test-framework/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/build/test-framework/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/build/codecs/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-solrj/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/build/analysis/common/lucene-analyzers-common-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/build/codecs/lucene-codecs-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/build/highlighter/lucene-highlighter-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/build/memory/lucene-memory-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/build/misc/lucene-misc-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/build/spatial/lucene-spatial-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/build/suggest/lucene-suggest-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/build/grouping/lucene-grouping-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/build/queries/lucene-queries-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/build/queryparser/lucene-queryparser-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/core/lib/cglib-nodep-2.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/core/lib/commons-cli-1.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/core/lib/commons-codec-1.7.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/core/lib/commons-fileupload-1.2.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/core/lib/commons-lang-2.6.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/core/lib/easymock-3.0.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/core/lib/guava-13.0.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/core/lib/javax.servlet-api-3.0.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/core/lib/objenesis-1.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/core/lib/org.restlet-2.1.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/core/lib/org.restlet.ext.servlet-2.1.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/core/lib/spatial4j-0.3.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/solrj/lib/commons-io-2.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/solrj/lib/httpclient-4.2.3.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/solrj/lib/httpcore-4.2.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/solrj/lib/httpmime-4.2.3.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/solrj/lib/jcl-over-slf4j-1.6.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/solrj/lib/noggit-0.5.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/solrj/lib/slf4j-api-1.6.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/solrj/lib/slf4j-jdk14-1.6.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/solrj/lib/wstx-asl-3.2.7.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/solrj/lib/zookeeper-3.4.5.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/example/lib/jetty-continuation-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/example/lib/jetty-deploy-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/example/lib/jetty-http-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/example/lib/jetty-io-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/example/lib/jetty-jmx-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/example/lib/jetty-security-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/example/lib/jetty-server-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/example/lib/jetty-servlet-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/example/lib/jetty-util-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/example/lib/jetty-webapp-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/example/lib/jetty-xml-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/example/lib/servlet-api-3.0.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/example/example-DIH/solr/db/lib/hsqldb-1.8.0.10.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/build/core/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/test-framework/lib/junit-4.10.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/test-framework/lib/randomizedtesting-runner-2.0.8.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-launcher.jar:/home/hudson/.ant/lib/ivy-2.2.0.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-logging.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-regexp.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-oro.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-swing.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jdepend.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-xalan2.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bsf.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit4.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-net.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-antlr.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jmf.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-netrexx.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-log4j.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-resolver.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jsch.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-testutil.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bcel.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jai.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-javamail.jar:/usr/local/openjdk7/lib/tools.jar:/home/hudson/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.0.8.jar
[junit4:junit4]   2> 335 T23 oaz.Environment.logEnv Client environment:java.library.path=/usr/local/openjdk7/jre/lib/amd64/server:/usr/local/openjdk7/jre/lib/amd64:/usr/local/openjdk7/jre/../lib/amd64:/usr/local/openjdk6/jre/lib/amd64/server:/usr/local/openjdk6/jre/lib/amd64:/usr/local/openjdk6/jre/../lib/amd64:/usr/java/packages/lib/amd64:/lib:/usr/lib:/usr/local/lib
[junit4:junit4]   2> 335 T23 oaz.Environment.logEnv Client environment:java.io.tmpdir=.
[junit4:junit4]   2> 336 T23 oaz.Environment.logEnv Client environment:java.compiler=<NA>
[junit4:junit4]   2> 337 T23 oaz.Environment.logEnv Client environment:os.name=FreeBSD
[junit4:junit4]   2> 337 T23 oaz.Environment.logEnv Client environment:os.arch=amd64
[junit4:junit4]   2> 338 T23 oaz.Environment.logEnv Client environment:os.version=9.0-RELEASE
[junit4:junit4]   2> 338 T23 oaz.Environment.logEnv Client environment:user.name=hudson
[junit4:junit4]   2> 339 T23 oaz.Environment.logEnv Client environment:user.home=/home/hudson
[junit4:junit4]   2> 339 T23 oaz.Environment.logEnv Client environment:user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1
[junit4:junit4]   2> 345 T23 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58321 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@2c72e086
[junit4:junit4]   2> 430 T23 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 438 T29 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:58321. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 441 T29 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:58321, initiating session
[junit4:junit4]   2> 441 T25 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:50236
[junit4:junit4]   2> 473 T25 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:50236
[junit4:junit4]   2> 488 T27 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 529 T27 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8cab96670000 with negotiated timeout 10000 for client /140.211.11.196:50236
[junit4:junit4]   2> 529 T29 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:58321, sessionid = 0x13d8cab96670000, negotiated timeout = 10000
[junit4:junit4]   2> 536 T30 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2c72e086 name:ZooKeeperConnection Watcher:127.0.0.1:58321 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 536 T23 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 541 T23 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 623 T28 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d8cab96670000
[junit4:junit4]   2> 634 T30 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 634 T23 oaz.ZooKeeper.close Session: 0x13d8cab96670000 closed
[junit4:junit4]   2> 635 T25 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:50236 which had sessionid 0x13d8cab96670000
[junit4:junit4]   2> 635 T23 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58321/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@3d5045ad
[junit4:junit4]   2> 636 T23 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 637 T31 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:58321. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 638 T31 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:58321, initiating session
[junit4:junit4]   2> 638 T25 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:31207
[junit4:junit4]   2> 639 T25 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:31207
[junit4:junit4]   2> 640 T27 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8cab96670001 with negotiated timeout 10000 for client /140.211.11.196:31207
[junit4:junit4]   2> 641 T31 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:58321, sessionid = 0x13d8cab96670001, negotiated timeout = 10000
[junit4:junit4]   2> 641 T32 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3d5045ad name:ZooKeeperConnection Watcher:127.0.0.1:58321/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 642 T23 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 656 T23 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 686 T23 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 726 T23 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 731 T23 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 789 T23 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 791 T23 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 830 T23 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 832 T23 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 942 T23 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 943 T23 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 948 T23 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 949 T23 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 954 T23 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 955 T23 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 960 T23 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 961 T23 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 966 T23 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 967 T23 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 972 T23 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 973 T23 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 978 T23 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 979 T23 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 984 T28 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d8cab96670001
[junit4:junit4]   2> 985 T32 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 985 T23 oaz.ZooKeeper.close Session: 0x13d8cab96670001 closed
[junit4:junit4]   2> 985 T25 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:31207 which had sessionid 0x13d8cab96670001
[junit4:junit4]   2> 1766 T23 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 2011 T23 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:32209
[junit4:junit4]   2> 2049 T23 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 2050 T23 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 2050 T23 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1363864688936
[junit4:junit4]   2> 2051 T23 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1363864688936/solr.xml
[junit4:junit4]   2> 2051 T23 oasc.CoreContainer.<init> New CoreContainer 2026758914
[junit4:junit4]   2> 2052 T23 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1363864688936/'
[junit4:junit4]   2> 2052 T23 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1363864688936/'
[junit4:junit4]   2> 2164 T23 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 2165 T23 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 2165 T23 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 2165 T23 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 2166 T23 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 2166 T23 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 2167 T23 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 2167 T23 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 2167 T23 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 2215 T23 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 2688 T23 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 2708 T23 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:58321/solr
[junit4:junit4]   2> 2731 T23 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 2731 T23 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58321 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1642d13e
[junit4:junit4]   2> 2732 T23 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2734 T43 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:58321. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 2734 T43 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:58321, initiating session
[junit4:junit4]   2> 2735 T25 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:63866
[junit4:junit4]   2> 2735 T25 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:63866
[junit4:junit4]   2> 2738 T27 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8cab96670002 with negotiated timeout 20000 for client /140.211.11.196:63866
[junit4:junit4]   2> 2738 T43 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:58321, sessionid = 0x13d8cab96670002, negotiated timeout = 20000
[junit4:junit4]   2> 2739 T44 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1642d13e name:ZooKeeperConnection Watcher:127.0.0.1:58321 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2739 T23 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2741 T28 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d8cab96670002
[junit4:junit4]   2> 2743 T25 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:63866 which had sessionid 0x13d8cab96670002
[junit4:junit4]   2> 2743 T44 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 2743 T23 oaz.ZooKeeper.close Session: 0x13d8cab96670002 closed
[junit4:junit4]   2> 2747 T23 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 2761 T23 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58321/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@60a7d346
[junit4:junit4]   2> 2762 T23 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2763 T45 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:58321. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 2763 T45 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:58321, initiating session
[junit4:junit4]   2> 2764 T25 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:12108
[junit4:junit4]   2> 2764 T25 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:12108
[junit4:junit4]   2> 2766 T27 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8cab96670003 with negotiated timeout 20000 for client /140.211.11.196:12108
[junit4:junit4]   2> 2766 T45 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:58321, sessionid = 0x13d8cab96670003, negotiated timeout = 20000
[junit4:junit4]   2> 2766 T46 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@60a7d346 name:ZooKeeperConnection Watcher:127.0.0.1:58321/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2767 T23 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2776 T23 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4]   2> 2787 T28 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8cab96670003 type:create cxid:0x7 zxid:0x1b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2789 T23 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4]   2> 2804 T23 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 2808 T23 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:32209_pc_kzu%2Fvk
[junit4:junit4]   2> 2812 T28 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8cab96670003 type:delete cxid:0x12 zxid:0x1e txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:32209_pc_kzu%2Fvk Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:32209_pc_kzu%2Fvk
[junit4:junit4]   2> 2814 T23 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:32209_pc_kzu%2Fvk
[junit4:junit4]   2> 2819 T23 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 2839 T28 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8cab96670003 type:delete cxid:0x20 zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 2841 T23 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 2845 T23 oasc.Overseer.start Overseer (id=89382236207906819-127.0.0.1:32209_pc_kzu%2Fvk-n_0000000000) starting
[junit4:junit4]   2> 2846 T28 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8cab96670003 type:create cxid:0x25 zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2858 T28 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8cab96670003 type:create cxid:0x26 zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2860 T28 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8cab96670003 type:create cxid:0x28 zxid:0x27 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2862 T23 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4]   2> 2880 T28 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8cab96670003 type:create cxid:0x2e zxid:0x29 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2883 T48 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4]   2> 2883 T23 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 2886 T23 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4]   2> 2889 T23 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 2908 T47 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 2941 T49 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1363864688936/collection1
[junit4:junit4]   2> 2941 T49 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4]   2> 2942 T49 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 2943 T49 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4]   2> 2945 T49 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1363864688936/collection1/'
[junit4:junit4]   2> 2946 T49 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1363864688936/collection1/lib/README' to classloader
[junit4:junit4]   2> 2947 T49 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1363864688936/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 3027 T49 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4]   2> 3128 T49 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 3229 T49 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 3247 T49 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 3818 T49 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 3831 T49 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 3834 T49 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 3869 T49 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 3875 T49 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 3880 T49 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 3883 T49 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 3883 T49 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 3883 T49 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 3885 T49 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 3886 T49 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 3886 T49 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4]   2> 3914 T49 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1363864688936/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363864687968/control/data/
[junit4:junit4]   2> 3918 T49 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@636323cc
[junit4:junit4]   2> 3919 T49 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4]   2> 3920 T49 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363864687968/control/data forceNew: false
[junit4:junit4]   2> 3920 T49 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363864687968/control/data/index/
[junit4:junit4]   2> 3921 T49 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363864687968/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 3922 T49 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363864687968/control/data/index forceNew: false
[junit4:junit4]   2> 3927 T49 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363864687968/control/data/index,segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 3927 T49 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 3973 T49 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 3974 T49 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 3974 T49 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 3975 T49 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 3976 T49 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 3976 T49 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 3977 T49 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 3978 T49 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 3978 T49 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 3988 T49 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 3995 T49 oass.SolrIndexSearcher.<init> Opening Searcher@6b7d709f main
[junit4:junit4]   2> 4015 T49 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 4015 T49 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 4019 T50 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6b7d709f main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 4021 T49 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 4021 T49 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 4417 T47 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4418 T47 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:32209_pc_kzu%2Fvk",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:32209/pc_kzu/vk"}
[junit4:junit4]   2> 4418 T47 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4]   2> 4431 T47 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 4452 T46 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 5025 T49 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 5025 T49 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:32209/pc_kzu/vk collection:control_collection shard:shard1
[junit4:junit4]   2> 5043 T49 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4]   2> 5066 T49 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4]   2> 5095 T28 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8cab96670003 type:delete cxid:0x82 zxid:0x35 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4]   2> 5097 T49 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 5098 T28 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8cab96670003 type:create cxid:0x83 zxid:0x36 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5109 T49 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 5109 T49 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 5115 T49 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:32209/pc_kzu/vk/collection1/
[junit4:junit4]   2> 5116 T49 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 5116 T49 oasc.SyncStrategy.syncToMe http://127.0.0.1:32209/pc_kzu/vk/collection1/ has no replicas
[junit4:junit4]   2> 5117 T49 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:32209/pc_kzu/vk/collection1/
[junit4:junit4]   2> 5117 T49 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4]   2> 5125 T28 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8cab96670003 type:create cxid:0x8e zxid:0x3a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5959 T47 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5983 T46 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 6004 T49 oasc.ZkController.register We are http://127.0.0.1:32209/pc_kzu/vk/collection1/ and leader is http://127.0.0.1:32209/pc_kzu/vk/collection1/
[junit4:junit4]   2> 6007 T49 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:32209/pc_kzu/vk
[junit4:junit4]   2> 6007 T49 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 6008 T49 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 6008 T49 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 6011 T49 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6016 T23 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1
[junit4:junit4]   2> 6016 T23 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 6073 T23 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 6092 T23 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 6096 T23 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58321/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@4099dde9
[junit4:junit4]   2> 6097 T23 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6098 T52 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:58321. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 6098 T52 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:58321, initiating session
[junit4:junit4]   2> 6098 T25 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:29805
[junit4:junit4]   2> 6099 T25 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:29805
[junit4:junit4]   2> 6101 T27 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8cab96670004 with negotiated timeout 10000 for client /140.211.11.196:29805
[junit4:junit4]   2> 6101 T52 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:58321, sessionid = 0x13d8cab96670004, negotiated timeout = 10000
[junit4:junit4]   2> 6102 T53 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4099dde9 name:ZooKeeperConnection Watcher:127.0.0.1:58321/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6103 T23 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6105 T23 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 6110 T23 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 6317 T23 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 6320 T23 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:32591
[junit4:junit4]   2> 6321 T23 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 6322 T23 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 6323 T23 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1363864694060
[junit4:junit4]   2> 6323 T23 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1363864694060/solr.xml
[junit4:junit4]   2> 6324 T23 oasc.CoreContainer.<init> New CoreContainer 1145788263
[junit4:junit4]   2> 6325 T23 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1363864694060/'
[junit4:junit4]   2> 6325 T23 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1363864694060/'
[junit4:junit4]   2> 6400 T23 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 6401 T23 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 6401 T23 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 6402 T23 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 6403 T23 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 6403 T23 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 6404 T23 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 6404 T23 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 6405 T23 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 6406 T23 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 6433 T23 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 6457 T23 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:58321/solr
[junit4:junit4]   2> 6458 T23 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 6459 T23 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58321 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1020c592
[junit4:junit4]   2> 6460 T23 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6461 T63 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:58321. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 6462 T63 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:58321, initiating session
[junit4:junit4]   2> 6463 T25 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:46382
[junit4:junit4]   2> 6463 T25 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:46382
[junit4:junit4]   2> 6466 T27 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8cab96670005 with negotiated timeout 20000 for client /140.211.11.196:46382
[junit4:junit4]   2> 6466 T63 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:58321, sessionid = 0x13d8cab96670005, negotiated timeout = 20000
[junit4:junit4]   2> 6467 T64 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1020c592 name:ZooKeeperConnection Watcher:127.0.0.1:58321 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6467 T23 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6469 T28 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d8cab96670005
[junit4:junit4]   2> 6476 T64 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 6477 T25 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:46382 which had sessionid 0x13d8cab96670005
[junit4:junit4]   2> 6476 T23 oaz.ZooKeeper.close Session: 0x13d8cab96670005 closed
[junit4:junit4]   2> 6478 T23 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 6492 T23 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58321/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@68190e6b
[junit4:junit4]   2> 6494 T23 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6494 T65 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:58321. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 6495 T65 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:58321, initiating session
[junit4:junit4]   2> 6495 T25 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:54049
[junit4:junit4]   2> 6496 T25 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:54049
[junit4:junit4]   2> 6498 T27 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8cab96670006 with negotiated timeout 20000 for client /140.211.11.196:54049
[junit4:junit4]   2> 6498 T65 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:58321, sessionid = 0x13d8cab96670006, negotiated timeout = 20000
[junit4:junit4]   2> 6499 T66 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@68190e6b name:ZooKeeperConnection Watcher:127.0.0.1:58321/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6499 T23 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6501 T28 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8cab96670006 type:create cxid:0x1 zxid:0x48 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6504 T28 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8cab96670006 type:create cxid:0x3 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6508 T23 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 7499 T47 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7500 T47 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"127.0.0.1:32209_pc_kzu%2Fvk_collection1",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:32209_pc_kzu%2Fvk",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:32209/pc_kzu/vk"}
[junit4:junit4]   2> 7513 T46 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 7513 T53 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 7513 T66 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 7514 T23 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:32591_pc_kzu%2Fvk
[junit4:junit4]   2> 7515 T28 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8cab96670006 type:delete cxid:0xd zxid:0x4e txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:32591_pc_kzu%2Fvk Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:32591_pc_kzu%2Fvk
[junit4:junit4]   2> 7517 T23 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:32591_pc_kzu%2Fvk
[junit4:junit4]   2> 7527 T53 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 7528 T66 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 7528 T46 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 7529 T46 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 7528 T66 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 7530 T53 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 7541 T67 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1363864694060/collection1
[junit4:junit4]   2> 7541 T67 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 7542 T67 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 7543 T67 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 7545 T67 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1363864694060/collection1/'
[junit4:junit4]   2> 7546 T67 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1363864694060/collection1/lib/README' to classloader
[junit4:junit4]   2> 7547 T67 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1363864694060/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 7604 T67 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4]   2> 7672 T67 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 7774 T67 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 7799 T67 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 8614 T67 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 8635 T67 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 8641 T67 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 8672 T67 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 8678 T67 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 8683 T67 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 8684 T67 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 8685 T67 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 8685 T67 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 8687 T67 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 8687 T67 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 8687 T67 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4]   2> 8688 T67 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1363864694060/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363864687968/jetty1/
[junit4:junit4]   2> 8688 T67 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@636323cc
[junit4:junit4]   2> 8689 T67 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4]   2> 8690 T67 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363864687968/jetty1 forceNew: false
[junit4:junit4]   2> 8690 T67 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363864687968/jetty1/index/
[junit4:junit4]   2> 8691 T67 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363864687968/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 8691 T67 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363864687968/jetty1/index forceNew: false
[junit4:junit4]   2> 8706 T67 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363864687968/jetty1/index,segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 8706 T67 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 8709 T67 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 8710 T67 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 8710 T67 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 8711 T67 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 8712 T67 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 8712 T67 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 8713 T67 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 8713 T67 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 8714 T67 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 8723 T67 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 8730 T67 oass.SolrIndexSearcher.<init> Opening Searcher@5f61bcbe main
[junit4:junit4]   2> 8731 T67 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 8731 T67 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 8735 T68 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5f61bcbe main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 8738 T67 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 8738 T67 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 9022 T47 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9024 T47 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"3",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:32591_pc_kzu%2Fvk",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:32591/pc_kzu/vk"}
[junit4:junit4]   2> 9024 T47 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 3
[junit4:junit4]   2> 9025 T47 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 9037 T66 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 9037 T53 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 9037 T46 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 9741 T67 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 9741 T67 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:32591/pc_kzu/vk collection:collection1 shard:shard1
[junit4:junit4]   2> 9743 T67 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 9763 T28 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8cab96670006 type:delete cxid:0x4c zxid:0x5a txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 9770 T67 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 9770 T28 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8cab96670006 type:create cxid:0x4d zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 9781 T67 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 9782 T67 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 9782 T67 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:32591/pc_kzu/vk/collection1/
[junit4:junit4]   2> 9782 T67 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 9783 T67 oasc.SyncStrategy.syncToMe http://127.0.0.1:32591/pc_kzu/vk/collection1/ has no replicas
[junit4:junit4]   2> 9783 T67 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:32591/pc_kzu/vk/collection1/
[junit4:junit4]   2> 9784 T67 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 9800 T28 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8cab96670006 type:create cxid:0x58 zxid:0x5f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 10544 T47 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10679 T66 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 10679 T46 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 10679 T53 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 10687 T67 oasc.ZkController.register We are http://127.0.0.1:32591/pc_kzu/vk/collection1/ and leader is http://127.0.0.1:32591/pc_kzu/vk/collection1/
[junit4:junit4]   2> 10687 T67 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:32591/pc_kzu/vk
[junit4:junit4]   2> 10688 T67 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 10688 T67 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 10688 T67 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 10691 T67 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10694 T23 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1
[junit4:junit4]   2> 10695 T23 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 10696 T23 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 10918 T23 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 10921 T23 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:18856
[junit4:junit4]   2> 10922 T23 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 10923 T23 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 10924 T23 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1363864698664
[junit4:junit4]   2> 10924 T23 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1363864698664/solr.xml
[junit4:junit4]   2> 10925 T23 oasc.CoreContainer.<init> New CoreContainer 1445412951
[junit4:junit4]   2> 10926 T23 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1363864698664/'
[junit4:junit4]   2> 10926 T23 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1363864698664/'
[junit4:junit4]   2> 11006 T23 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 11007 T23 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 11008 T23 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 11008 T23 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 11009 T23 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 11010 T23 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 11010 T23 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 11011 T23 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 11011 T23 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 11012 T23 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 11042 T23 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 11067 T23 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:58321/solr
[junit4:junit4]   2> 11068 T23 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 11068 T23 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58321 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@3fd01553
[junit4:junit4]   2> 11070 T23 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 11070 T79 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:58321. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 11071 T79 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:58321, initiating session
[junit4:junit4]   2> 11072 T25 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:18857
[junit4:junit4]   2> 11073 T25 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:18857
[junit4:junit4]   2> 11074 T27 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8cab96670007 with negotiated timeout 20000 for client /140.211.11.196:18857
[junit4:junit4]   2> 11074 T79 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:58321, sessionid = 0x13d8cab96670007, negotiated timeout = 20000
[junit4:junit4]   2> 11075 T80 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3fd01553 name:ZooKeeperConnection Watcher:127.0.0.1:58321 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 11076 T23 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 11078 T28 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d8cab96670007
[junit4:junit4]   2> 11083 T80 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 11083 T23 oaz.ZooKeeper.close Session: 0x13d8cab96670007 closed
[junit4:junit4]   2> 11083 T25 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:18857 which had sessionid 0x13d8cab96670007
[junit4:junit4]   2> 11084 T23 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 11099 T23 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58321/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@25299a21
[junit4:junit4]   2> 11101 T23 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 11101 T81 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:58321. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 11102 T81 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:58321, initiating session
[junit4:junit4]   2> 11102 T25 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:18858
[junit4:junit4]   2> 11103 T25 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:18858
[junit4:junit4]   2> 11108 T27 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8cab96670008 with negotiated timeout 20000 for client /140.211.11.196:18858
[junit4:junit4]   2> 11108 T81 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:58321, sessionid = 0x13d8cab96670008, negotiated timeout = 20000
[junit4:junit4]   2> 11109 T82 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@25299a21 name:ZooKeeperConnection Watcher:127.0.0.1:58321/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 11109 T23 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 11111 T28 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8cab96670008 type:create cxid:0x1 zxid:0x6c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 11113 T28 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8cab96670008 type:create cxid:0x3 zxid:0x6d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 11123 T23 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 12129 T23 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:18856_pc_kzu%2Fvk
[junit4:junit4]   2> 12130 T28 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8cab96670008 type:delete cxid:0xd zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:18856_pc_kzu%2Fvk Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:18856_pc_kzu%2Fvk
[junit4:junit4]   2> 12131 T23 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:18856_pc_kzu%2Fvk
[junit4:junit4]   2> 12136 T53 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 12136 T66 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 12137 T46 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 12137 T66 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 12137 T82 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 12137 T46 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 12141 T53 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 12148 T83 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1363864698664/collection1
[junit4:junit4]   2> 12149 T83 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 12150 T83 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 12150 T83 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 12156 T83 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1363864698664/collection1/'
[junit4:junit4]   2> 12157 T83 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1363864698664/collection1/lib/README' to classloader
[junit4:junit4]   2> 12158 T83 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1363864698664/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 12193 T47 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 12195 T47 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"127.0.0.1:32591_pc_kzu%2Fvk_collection1",
[junit4:junit4]   2> 	  "numShards":"3",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:32591_pc_kzu%2Fvk",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:32591/pc_kzu/vk"}
[junit4:junit4]   2> 12204 T66 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 12204 T82 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 12204 T46 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 12204 T53 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 12221 T83 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4]   2> 12289 T83 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 12390 T83 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 12404 T83 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 13109 T83 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 13125 T83 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 13130 T83 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 13168 T83 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 13174 T83 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 13180 T83 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 13182 T83 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 13183 T83 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 13183 T83 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 13185 T83 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 13185 T83 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 13186 T83 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4]   2> 13186 T83 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1363864698664/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363864687968/jetty2/
[junit4:junit4]   2> 13187 T83 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@636323cc
[junit4:junit4]   2> 13188 T83 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4]   2> 13189 T83 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363864687968/jetty2 forceNew: false
[junit4:junit4]   2> 13190 T83 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363864687968/jetty2/index/
[junit4:junit4]   2> 13190 T83 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363864687968/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 13191 T83 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363864687968/jetty2/index forceNew: false
[junit4:junit4]   2> 13200 T83 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363864687968/jetty2/index,segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 13200 T83 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 13204 T83 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 13204 T83 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 13205 T83 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 13206 T83 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 13207 T83 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 13207 T83 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 13208 T83 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 13209 T83 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 13209 T83 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 13222 T83 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 13230 T83 oass.SolrIndexSearcher.<init> Opening Searcher@5e9a681a main
[junit4:junit4]   2> 13231 T83 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 13232 T83 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 13238 T84 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5e9a681a main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 13241 T83 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 13242 T83 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 13713 T47 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 13715 T47 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"3",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:18856_pc_kzu%2Fvk",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:18856/pc_kzu/vk"}
[junit4:junit4]   2> 13716 T47 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4:junit4]   2> 13716 T47 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4]   2> 13729 T46 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 13730 T66 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 13730 T53 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 13730 T82 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 14245 T83 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 14245 T83 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:18856/pc_kzu/vk collection:collection1 shard:shard2
[junit4:junit4]   2> 14247 T83 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4]   2> 14268 T28 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8cab96670008 type:delete cxid:0x49 zxid:0x7d txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard2 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard2
[junit4:junit4]   2> 14269 T83 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 14270 T28 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8cab96670008 type:create cxid:0x4a zxid:0x7e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 14281 T83 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 14282 T83 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 14282 T83 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:18856/pc_kzu/vk/collection1/
[junit4:junit4]   2> 14282 T83 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 14283 T83 oasc.SyncStrategy.syncToMe http://127.0.0.1:18856/pc_kzu/vk/collection1/ has no replicas
[junit4:junit4]   2> 14283 T83 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:18856/pc_kzu/vk/collection1/
[junit4:junit4]   2> 14284 T83 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4]   2> 14290 T28 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8cab96670008 type:create cxid:0x54 zxid:0x81 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 15238 T47 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 15267 T46 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 15267 T82 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 15267 T53 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 15267 T66 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 15321 T83 oasc.ZkController.register We are http://127.0.0.1:18856/pc_kzu/vk/collection1/ and leader is http://127.0.0.1:18856/pc_kzu/vk/collection1/
[junit4:junit4]   2> 15321 T83 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:18856/pc_kzu/vk
[junit4:junit4]   2> 15322 T83 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 15322 T83 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 15322 T83 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 15326 T83 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 15327 T23 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1
[junit4:junit4]   2> 15328 T23 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 15329 T23 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 15529 T23 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 15533 T23 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:18862
[junit4:junit4]   2> 15534 T23 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 15535 T23 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 15535 T23 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1363864703291
[junit4:junit4]   2> 15536 T23 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1363864703291/solr.xml
[junit4:junit4]   2> 15536 T23 oasc.CoreContainer.<init> New CoreContainer 1774911181
[junit4:junit4]   2> 15537 T23 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1363864703291/'
[junit4:junit4]   2> 15538 T23 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1363864703291/'
[junit4:junit4]   2> 15607 T23 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 15608 T23 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 15609 T23 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 15609 T23 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 15610 T23 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 15610 T23 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 15611 T23 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 15612 T23 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 15612 T23 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 15613 T23 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 15639 T23 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 15661 T23 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:58321/solr
[junit4:junit4]   2> 15661 T23 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 15662 T23 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58321 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@59f74ada
[junit4:junit4]   2> 15663 T23 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 15664 T95 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:58321. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 15665 T95 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:58321, initiating session
[junit4:junit4]   2> 15666 T25 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:18863
[junit4:junit4]   2> 15666 T25 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:18863
[junit4:junit4]   2> 15674 T27 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8cab96670009 with negotiated timeout 20000 for client /140.211.11.196:18863
[junit4:junit4]   2> 15674 T95 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:58321, sessionid = 0x13d8cab96670009, negotiated timeout = 20000
[junit4:junit4]   2> 15675 T96 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@59f74ada name:ZooKeeperConnection Watcher:127.0.0.1:58321 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 15675 T23 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 15678 T28 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d8cab96670009
[junit4:junit4]   2> 15686 T96 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 15686 T23 oaz.ZooKeeper.close Session: 0x13d8cab96670009 closed
[junit4:junit4]   2> 15686 T25 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:18863 which had sessionid 0x13d8cab96670009
[junit4:junit4]   2> 15687 T23 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 15702 T23 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58321/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@786ccffd
[junit4:junit4]   2> 15704 T23 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 15704 T97 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:58321. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 15705 T97 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:58321, initiating session
[junit4:junit4]   2> 15705 T25 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:18864
[junit4:junit4]   2> 15706 T25 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:18864
[junit4:junit4]   2> 15710 T27 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8cab9667000a with negotiated timeout 20000 for client /140.211.11.196:18864
[junit4:junit4]   2> 15710 T97 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:58321, sessionid = 0x13d8cab9667000a, negotiated timeout = 20000
[junit4:junit4]   2> 15711 T98 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@786ccffd name:ZooKeeperConnection Watcher:127.0.0.1:58321/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 15711 T23 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 15713 T28 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8cab9667000a type:create cxid:0x1 zxid:0x8e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 15729 T28 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8cab9667000a type:create cxid:0x3 zxid:0x8f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 15733 T23 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 16739 T23 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:18862_pc_kzu%2Fvk
[junit4:junit4]   2> 16740 T28 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8cab9667000a type:delete cxid:0xd zxid:0x90 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:18862_pc_kzu%2Fvk Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:18862_pc_kzu%2Fvk
[junit4:junit4]   2> 16775 T23 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:18862_pc_kzu%2Fvk
[junit4:junit4]   2> 16784 T53 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 16785 T47 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 16785 T66 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 16785 T66 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 16786 T98 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 16786 T82 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 16786 T82 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 16787 T47 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"127.0.0.1:18856_pc_kzu%2Fvk_collection1",
[junit4:junit4]   2> 	  "numShards":"3",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:18856_pc_kzu%2Fvk",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:18856/pc_kzu/vk"}
[junit4:junit4]   2> 16798 T53 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 16805 T66 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 16806 T82 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 16805 T53 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 16805 T98 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 16809 T99 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1363864703291/collection1
[junit4:junit4]   2> 16809 T99 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 16815 T99 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 16816 T99 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 16817 T46 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 16817 T46 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 16818 T99 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1363864703291/collection1/'
[junit4:junit4]   2> 16820 T99 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1363864703291/collection1/lib/README' to classloader
[junit4:junit4]   2> 16820 T46 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 16821 T99 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1363864703291/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 16881 T99 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4]   2> 16952 T99 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 17053 T99 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 17065 T99 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 17752 T99 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 17764 T99 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 17767 T99 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 17793 T99 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 17798 T99 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 17802 T99 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 17803 T99 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 17804 T99 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 17804 T99 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 17806 T99 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 17806 T99 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 17806 T99 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4]   2> 17807 T99 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1363864703291/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363864687968/jetty3/
[junit4:junit4]   2> 17807 T99 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@636323cc
[junit4:junit4]   2> 17808 T99 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4]   2> 17808 T99 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363864687968/jetty3 forceNew: false
[junit4:junit4]   2> 17809 T99 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363864687968/jetty3/index/
[junit4:junit4]   2> 17810 T99 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363864687968/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 17811 T99 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363864687968/jetty3/index forceNew: false
[junit4:junit4]   2> 17815 T99 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363864687968/jetty3/index,segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 17816 T99 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 17818 T99 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 17819 T99 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 17819 T99 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 17820 T99 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 17821 T99 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 17821 T99 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 17821 T99 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 17822 T99 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 17822 T99 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 17833 T99 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 17839 T99 oass.SolrIndexSearcher.<init> Opening Searcher@597a8430 main
[junit4:junit4]   2> 17840 T99 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 17840 T99 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 17844 T100 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@597a8430 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 17847 T99 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 17847 T99 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 18318 T47 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 18320 T47 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"3",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:18862_pc_kzu%2Fvk",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:18862/pc_kzu/vk"}
[junit4:junit4]   2> 18320 T47 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4:junit4]   2> 18320 T47 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
[junit4:junit4]   2> 18334 T46 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 18334 T98 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 18334 T82 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 18334 T53 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 18334 T66 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 18851 T99 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 18851 T99 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:18862/pc_kzu/vk collection:collection1 shard:shard3
[junit4:junit4]   2> 18853 T99 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
[junit4:junit4]   2> 18868 T28 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8cab9667000a type:delete cxid:0x49 zxid:0x9f txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard3 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard3
[junit4:junit4]   2> 18869 T99 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 18870 T28 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8cab9667000a type:create cxid:0x4a zxid:0xa0 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 18879 T99 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 18880 T99 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 18880 T99 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:18862/pc_kzu/vk/collection1/
[junit4:junit4]   2> 18880 T99 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 18880 T99 oasc.SyncStrategy.syncToMe http://127.0.0.1:18862/pc_kzu/vk/collection1/ has no replicas
[junit4:junit4]   2> 18881 T99 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:18862/pc_kzu/vk/collection1/
[junit4:junit4]   2> 18881 T99 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3
[junit4:junit4]   2> 18886 T28 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8cab9667000a type:create cxid:0x54 zxid:0xa3 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 19841 T47 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 19864 T46 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 19864 T53 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 19864 T98 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 19864 T82 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 19864 T66 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 19917 T99 oasc.ZkController.register We are http://127.0.0.1:18862/pc_kzu/vk/collection1/ and leader is http://127.0.0.1:18862/pc_kzu/vk/collection1/
[junit4:junit4]   2> 19917 T99 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:18862/pc_kzu/vk
[junit4:junit4]   2> 19917 T99 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 19917 T99 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 19918 T99 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 19920 T99 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 19922 T23 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1
[junit4:junit4]   2> 19922 T23 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 19923 T23 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 20093 T23 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 20096 T23 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:18865
[junit4:junit4]   2> 20097 T23 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 20097 T23 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 20098 T23 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1363864707883
[junit4:junit4]   2> 20098 T23 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1363864707883/solr.xml
[junit4:junit4]   2> 20099 T23 oasc.CoreContainer.<init> New CoreContainer 259111992
[junit4:junit4]   2> 20099 T23 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1363864707883/'
[junit4:junit4]   2> 20100 T23 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1363864707883/'
[junit4:junit4]   2> 20152 T23 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 20153 T23 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 20153 T23 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 20153 T23 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 20154 T23 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 20154 T23 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 20155 T23 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 20155 T23 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 20155 T23 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 20156 T23 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 20171 T23 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 20186 T23 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:58321/solr
[junit4:junit4]   2> 20187 T23 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 20187 T23 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58321 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@19eac7d5
[junit4:junit4]   2> 20188 T23 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 20189 T111 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:58321. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 20189 T111 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:58321, initiating session
[junit4:junit4]   2> 20190 T25 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:18866
[junit4:junit4]   2> 20190 T25 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:18866
[junit4:junit4]   2> 20193 T27 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8cab9667000b with negotiated timeout 20000 for client /140.211.11.196:18866
[junit4:junit4]   2> 20193 T111 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:58321, sessionid = 0x13d8cab9667000b, negotiated timeout = 20000
[junit4:junit4]   2> 20193 T112 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@19eac7d5 name:ZooKeeperConnection Watcher:127.0.0.1:58321 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 20193 T23 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 20195 T28 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d8cab9667000b
[junit4:junit4]   2> 20207 T112 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 20208 T25 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:18866 which had sessionid 0x13d8cab9667000b
[junit4:junit4]   2> 20207 T23 oaz.ZooKeeper.close Session: 0x13d8cab9667000b closed
[junit4:junit4]   2> 20209 T23 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 20217 T23 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58321/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@5cf901e6
[junit4:junit4]   2> 20218 T23 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 20219 T113 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:58321. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 20219 T113 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:58321, initiating session
[junit4:junit4]   2> 20220 T25 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:18867
[junit4:junit4]   2> 20220 T25 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:18867
[junit4:junit4]   2> 20222 T27 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8cab9667000c with negotiated timeout 20000 for client /140.211.11.196:18867
[junit4:junit4]   2> 20222 T113 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:58321, sessionid = 0x13d8cab9667000c, negotiated timeout = 20000
[junit4:junit4]   2> 20222 T114 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5cf901e6 name:ZooKeeperConnection Watcher:127.0.0.1:58321/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 20223 T23 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 20224 T28 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8cab9667000c type:create cxid:0x1 zxid:0xb0 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 20226 T28 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8cab9667000c type:create cxid:0x3 zxid:0xb1 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 20229 T23 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 21234 T23 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:18865_pc_kzu%2Fvk
[junit4:junit4]   2> 21235 T28 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8cab9667000c type:delete cxid:0xd zxid:0xb2 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:18865_pc_kzu%2Fvk Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:18865_pc_kzu%2Fvk
[junit4:junit4]   2> 21237 T23 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:18865_pc_kzu%2Fvk
[junit4:junit4]   2> 21243 T114 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 21243 T53 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 21243 T66 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 21244 T46 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 21244 T82 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 21243 T98 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 21244 T46 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 21244 T66 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 21245 T98 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 21245 T82 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 21248 T53 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 21256 T115 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1363864707883/collection1
[junit4:junit4]   2> 21256 T115 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 21257 T115 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 21257 T115 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 21260 T115 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1363864707883/collection1/'
[junit4:junit4]   2> 21261 T115 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1363864707883/collection1/lib/README' to classloader
[junit4:junit4]   2> 21262 T115 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1363864707883/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 21314 T115 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4]   2> 21374 T47 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 21376 T47 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"127.0.0.1:18862_pc_kzu%2Fvk_collection1",
[junit4:junit4]   2> 	  "numShards":"3",
[junit4:junit4]   2> 	  "shard":"shard3",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:18862_pc_kzu%2Fvk",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:18862/pc_kzu/vk"}
[junit4:junit4]   2> 21377 T115 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 21389 T66 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 21389 T46 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 21389 T98 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 21389 T53 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 21389 T82 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 21478 T115 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 21478 T114 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 21488 T115 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 22204 T115 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 22214 T115 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 22217 T115 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 22242 T115 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 22246 T115 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 22250 T115 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 22252 T115 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 22252 T115 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 22253 T115 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 22254 T115 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 22254 T115 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 22255 T115 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4]   2> 22255 T115 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1363864707883/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363864687968/jetty4/
[junit4:junit4]   2> 22255 T115 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@636323cc
[junit4:junit4]   2> 22256 T115 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4]   2> 22257 T115 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363864687968/jetty4 forceNew: false
[junit4:junit4]   2> 22257 T115 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363864687968/jetty4/index/
[junit4:junit4]   2> 22258 T115 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363864687968/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 22258 T115 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363864687968/jetty4/index forceNew: false
[junit4:junit4]   2> 22262 T115 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363864687968/jetty4/index,segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 22262 T115 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 22265 T115 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 22265 T115 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 22266 T115 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 22267 T115 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 22267 T115 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 22267 T115 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 22268 T115 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 22268 T115 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 22269 T115 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 22277 T115 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 22283 T115 oass.SolrIndexSearcher.<init> Opening Searcher@508892c2 main
[junit4:junit4]   2> 22284 T115 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 22284 T115 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 22289 T116 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@508892c2 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 22291 T115 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 22292 T115 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 22897 T47 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 22899 T47 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"3",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:18865_pc_kzu%2Fvk",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:18865/pc_kzu/vk"}
[junit4:junit4]   2> 22899 T47 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4:junit4]   2> 22900 T47 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 22916 T66 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 22916 T46 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 22916 T114 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 22916 T53 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 22916 T98 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 22916 T82 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 23294 T115 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 23294 T115 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:18865/pc_kzu/vk collection:collection1 shard:shard1
[junit4:junit4]   2> 23299 T115 oasc.ZkController.register We are http://127.0.0.1:18865/pc_kzu/vk/collection1/ and leader is http://127.0.0.1:32591/pc_kzu/vk/collection1/
[junit4:junit4]   2> 23299 T115 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:18865/pc_kzu/vk
[junit4:junit4]   2> 23300 T115 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 23300 T115 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C6 name=collection1 org.apache.solr.core.SolrCore@58456d6e url=http://127.0.0.1:18865/pc_kzu/vk/collection1 node=127.0.0.1:18865_pc_kzu%2Fvk C6_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:18865_pc_kzu%2Fvk, base_url=http://127.0.0.1:18865/pc_kzu/vk}
[junit4:junit4]   2> 23307 T117 C6 P18865 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 23308 T115 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 23308 T117 C6 P18865 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 23309 T117 C6 P18865 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 23309 T117 C6 P18865 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 23310 T23 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1
[junit4:junit4]   2> 23311 T23 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 23312 T117 C6 P18865 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 23312 T23 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 23605 T23 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 23609 T23 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:18873
[junit4:junit4]   2> 23610 T23 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 23611 T23 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 23611 T23 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1363864711286
[junit4:junit4]   2> 23612 T23 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1363864711286/solr.xml
[junit4:junit4]   2> 23613 T23 oasc.CoreContainer.<init> New CoreContainer 2144609923
[junit4:junit4]   2> 23613 T23 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1363864711286/'
[junit4:junit4]   2> 23614 T23 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1363864711286/'
[junit4:junit4]   2> 23709 T23 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 23710 T23 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 23711 T23 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 23711 T23 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 23712 T23 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 23712 T23 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 23713 T23 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 23714 T23 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 23714 T23 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 23715 T23 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 23745 T23 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 23770 T23 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:58321/solr
[junit4:junit4]   2> 23771 T23 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 23771 T23 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58321 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@6095cc5b
[junit4:junit4]   2> 23773 T23 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 23773 T128 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:58321. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 23774 T128 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:58321, initiating session
[junit4:junit4]   2> 23774 T25 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:18875
[junit4:junit4]   2> 23775 T25 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:18875
[junit4:junit4]   2> 23777 T27 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8cab9667000d with negotiated timeout 20000 for client /140.211.11.196:18875
[junit4:junit4]   2> 23777 T128 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:58321, sessionid = 0x13d8cab9667000d, negotiated timeout = 20000
[junit4:junit4]   2> 23778 T129 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6095cc5b name:ZooKeeperConnection Watcher:127.0.0.1:58321 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 23778 T23 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 23780 T28 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d8cab9667000d
[junit4:junit4]   2> 23782 T129 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 23782 T23 oaz.ZooKeeper.close Session: 0x13d8cab9667000d closed
[junit4:junit4]   2> 23782 T25 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:18875 which had sessionid 0x13d8cab9667000d
[junit4:junit4]   2> 23783 T23 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 23797 T23 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58321/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@2bf525ec
[junit4:junit4]   2> 23799 T23 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 23799 T130 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:58321. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 23800 T130 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:58321, initiating session
[junit4:junit4]   2> 23800 T25 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:18876
[junit4:junit4]   2> 23801 T25 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:18876
[junit4:junit4]   2> 23802 T27 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8cab9667000e with negotiated timeout 20000 for client /140.211.11.196:18876
[junit4:junit4]   2> 23802 T130 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:58321, sessionid = 0x13d8cab9667000e, negotiated timeout = 20000
[junit4:junit4]   2> 23803 T131 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2bf525ec name:ZooKeeperConnection Watcher:127.0.0.1:58321/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 23803 T23 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 23805 T28 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8cab9667000e type:create cxid:0x1 zxid:0xc3 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 23808 T28 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8cab9667000e type:create cxid:0x3 zxid:0xc4 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 23812 T23 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 24424 T47 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 24426 T47 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"127.0.0.1:18865_pc_kzu%2Fvk_collection1",
[junit4:junit4]   2> 	  "numShards":"3",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:18865_pc_kzu%2Fvk",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:18865/pc_kzu/vk"}
[junit4:junit4]   2> 24435 T114 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 24435 T131 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 24435 T66 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 24435 T98 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 24435 T82 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 24435 T53 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 24435 T46 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 24570 T56 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {coreNodeName=127.0.0.1:18865_pc_kzu%252Fvk_collection1&state=recovering&nodeName=127.0.0.1:18865_pc_kzu%252Fvk&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=4 
[junit4:junit4]   2> 24817 T23 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:18873_pc_kzu%2Fvk
[junit4:junit4]   2> 24819 T28 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8cab9667000e type:delete cxid:0xf zxid:0xc9 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:18873_pc_kzu%2Fvk Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:18873_pc_kzu%2Fvk
[junit4:junit4]   2> 24821 T23 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:18873_pc_kzu%2Fvk
[junit4:junit4]   2> 24824 T114 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 24824 T53 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 24824 T131 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 24825 T82 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4]   2> 24825 T46 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4]   2> 24825 T66 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4]   2> 24825 T98 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4]   2> 24827 T46 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4]   2> 24827 T82 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4]   2> 24826 T114 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4]   2> 24828 T98 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4]   2> 24828 T66 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4]   2> 24834 T53 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4]   2> 24835 T131 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4]   2> 24844 T132 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1363864711286/collection1
[junit4:junit4]   2> 24844 T132 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 24845 T132 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 24846 T132 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 24848 T132 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1363864711286/collection1/'
[junit4:junit4]   2> 24849 T132 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1363864711286/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 24850 T132 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1363864711286/collection1/lib/README' to classloader
[junit4:junit4]   2> 24911 T132 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4]   2> 24961 T132 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 24962 T132 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 24969 T132 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 25459 T132 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 25468 T132 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 25483 T132 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 25507 T132 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 25511 T132 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 25515 T132 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 25517 T132 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 25517 T132 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 25517 T132 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 25519 T132 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 25519 T132 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 25519 T132 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4]   2> 25520 T132 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1363864711286/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363864687968/jetty5/
[junit4:junit4]   2> 25520 T132 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@636323cc
[junit4:junit4]   2> 25520 T132 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4]   2> 25521 T132 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363864687968/jetty5 forceNew: false
[junit4:junit4]   2> 25522 T132 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363864687968/jetty5/index/
[junit4:junit4]   2> 25522 T132 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363864687968/jetty5/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 25523 T132 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363864687968/jetty5/index forceNew: false
[junit4:junit4]   2> 25548 T132 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363864687968/jetty5/index,segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 25548 T132 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 25551 T132 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 25551 T132 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 25552 T132 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 25553 T132 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 25553 T132 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 25553 T132 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 25554 T132 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 25555 T132 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 25555 T132 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 25564 T132 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 25569 T132 oass.SolrIndexSearcher.<init> Opening Searcher@660dec8b main
[junit4:junit4]   2> 25570 T132 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 25571 T132 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 25576 T133 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@660dec8b main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 25578 T132 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 25578 T132 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 25949 T47 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 25951 T47 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"3",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:18873_pc_kzu%2Fvk",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:18873/pc_kzu/vk"}
[junit4:junit4]   2> 25951 T47 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4:junit4]   2> 25951 T47 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4]   2> 25960 T114 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4]   2> 25960 T82 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4]   2> 25960 T98 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4]   2> 25960 T131 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4]   2> 25960 T66 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4]   2> 25960 T53 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4]   2> 25960 T46 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4]   2> 26617 T132 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 26617 T132 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:18873/pc_kzu/vk collection:collection1 shard:shard2
[junit4:junit4]   2> 26623 T132 oasc.ZkController.register We are http://127.0.0.1:18873/pc_kzu/vk/collection1/ and leader is http://127.0.0.1:18856/pc_kzu/vk/collection1/
[junit4:junit4]   2> 26623 T132 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:18873/pc_kzu/vk
[junit4:junit4]   2> 26623 T132 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 26624 T132 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C7 name=collection1 org.apache.solr.core.SolrCore@4062c054 url=http://127.0.0.1:18873/pc_kzu/vk/collection1 node=127.0.0.1:18873_pc_kzu%2Fvk C7_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:18873_pc_kzu%2Fvk, base_url=http://127.0.0.1:18873/pc_kzu/vk}
[junit4:junit4]   2> 26624 T134 C7 P18873 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 26625 T134 C7 P18873 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 26625 T132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 26625 T134 C7 P18873 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 26626 T134 C7 P18873 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 26627 T23 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1
[junit4:junit4]   2> 26628 T134 C7 P18873 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 26628 T23 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 26629 T23 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2>  C6_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:18865_pc_kzu%2Fvk, base_url=http://127.0.0.1:18865/pc_kzu/vk}
[junit4:junit4]   2> 26703 T117 C6 P18865 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:32591/pc_kzu/vk/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 26715 T117 C6 P18865 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4]   2> 26737 T117 C6 P18865 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:18865/pc_kzu/vk START replicas=[http://127.0.0.1:32591/pc_kzu/vk/collection1/] nUpdates=100
[junit4:junit4]   2> 26751 T117 C6 P18865 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 26751 T117 C6 P18865 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 26752 T117 C6 P18865 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 26752 T117 C6 P18865 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 26753 T117 C6 P18865 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 26753 T117 C6 P18865 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:32591/pc_kzu/vk/collection1/. core=collection1
[junit4:junit4]   2> 26753 T117 C6 P18865 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C8 name=collection1 org.apache.solr.core.SolrCore@2c3e866 url=http://127.0.0.1:32591/pc_kzu/vk/collection1 node=127.0.0.1:32591_pc_kzu%2Fvk C8_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:32591_pc_kzu%2Fvk, base_url=http://127.0.0.1:32591/pc_kzu/vk, leader=true}
[junit4:junit4]   2> 26813 T58 C8 P32591 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=7 
[junit4:junit4]   2> 26818 T57 C8 P32591 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 26824 T57 C8 P32591 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363864687968/jetty1/index,segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 26825 T57 C8 P32591 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 26845 T57 C8 P32591 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.

[...truncated too long message...]

dsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 145245 T1739 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> 173815 T1833 oasu.PeerSync.handleResponse WARNING PeerSync: core=collection1 url=http://127.0.0.1:44927/b/rt  couldn't connect to http://127.0.0.1:44920/b/rt/collection1/, counting as success
[junit4:junit4]   2> 173816 T1833 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:44927/b/rt DONE. sync succeeded
[junit4:junit4]   2> 173816 T1833 oasc.SyncStrategy.syncReplicas We have been closed, won't attempt to sync replicas back to leader
[junit4:junit4]   2> 173818 T1833 oasc.ShardLeaderElectionContext.rejoinLeaderElection Not rejoining election because CoreContainer is shutdown
[junit4:junit4]   2> 173818 T1833 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@1da63a80
[junit4:junit4]   2> 173819 T1833 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=10,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=305,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0}
[junit4:junit4]   2> 173820 T1833 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4]   2> 173820 T1833 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 173820 T1833 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2> 173821 T1833 C100 P44927 oasu.TransactionLog.forceClose SEVERE Error: Forcing close of tlog{file=./org.apache.solr.cloud.SyncSliceTest-1363865057797/jetty4/tlog/tlog.0000000000000000005 refcount=1}
[junit4:junit4]   2> 173823 T1833 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4]   2> 173825 T1833 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363865057797/jetty4
[junit4:junit4]   2> 173825 T1833 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363865057797/jetty4
[junit4:junit4]   2> 173825 T1833 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363865057797/jetty4/index
[junit4:junit4]   2> 173826 T1833 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363865057797/jetty4/index
[junit4:junit4]   2> 173826 T1833 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363865057797/jetty4/index.20130321072442869
[junit4:junit4]   2> 173826 T1833 oasc.CachingDirectoryFactory.closeDirectory Removing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363865057797/jetty4/index.20130321072442869
[junit4:junit4]   2> 173827 T1833 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363865057797/jetty4/index.20130321072442869
[junit4:junit4]   2> 173827 T1833 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:235)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:232)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:232)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:84)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]   2> 
[junit4:junit4]   2> 173828 T1833 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 173828 T1833 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 173828 T1833 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 173829 T1833 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> NOTE: test params are: codec=Asserting, sim=RandomSimilarityProvider(queryNorm=true,coord=no): {}, locale=ja_JP, timezone=America/Toronto
[junit4:junit4]   2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_17 (64-bit)/cpus=16,threads=3,free=248975376,total=476053504
[junit4:junit4]   2> NOTE: All tests run in this JVM: [TestStressLucene, TestLRUCache, StandardRequestHandlerTest, TestAnalyzedSuggestions, DocValuesMultiTest, ScriptEngineTest, PingRequestHandlerTest, LegacyHTMLStripCharFilterTest, TestSort, DisMaxRequestHandlerTest, RegexBoostProcessorTest, UpdateRequestProcessorFactoryTest, AlternateDirectoryTest, ZkCLITest, TestCharFilters, CoreAdminHandlerTest, QueryParsingTest, SolrCoreCheckLockOnStartupTest, TestBM25SimilarityFactory, OutputWriterTest, TestElisionMultitermQuery, OverseerTest, SliceStateUpdateTest, RecoveryZkTest, TestRecovery, TestShardHandlerFactory, TestQuerySenderNoQuery, TestFiltering, SystemInfoHandlerTest, TestLMDirichletSimilarityFactory, UniqFieldsUpdateProcessorFactoryTest, URLClassifyProcessorTest, TestCollationKeyRangeQueries, TestIndexSearcher, TestDynamicFieldCollectionResource, WordBreakSolrSpellCheckerTest, TestWordDelimiterFilterFactory, BinaryUpdateRequestHandlerTest, SimplePostToolTest, SchemaVersionSpecificBehaviorTest, SimpleFacetsTest, TestIndexingPerformance, TestFastOutputStream, AutoCommitTest, XmlUpdateRequestHandlerTest, TestPartialUpdateDeduplication, QueryElevationComponentTest, TestFastWriter, TestSolrDeletionPolicy1, FileUtilsTest, TestIBSimilarityFactory, TestCSVResponseWriter, TestJmxMonitoredMap, SortByFunctionTest, DistributedSpellCheckComponentTest, OverseerCollectionProcessorTest, TestSystemIdResolver, BadIndexSchemaTest, MoreLikeThisHandlerTest, DebugComponentTest, TestUpdate, TestReplicationHandler, NoCacheHeaderTest, SynonymTokenizerTest, SolrRequestParserTest, SyncSliceTest]
[junit4:junit4] Completed on J0 in 174.31s, 1 test, 1 failure <<< FAILURES!

[...truncated 479 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/build.xml:381: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/build.xml:361: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build.xml:183: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/common-build.xml:449: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/common-build.xml:1213: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/common-build.xml:877: There were test failures: 273 suites, 1147 tests, 2 failures, 27 ignored (8 assumptions)

Total time: 47 minutes 48 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-Tests-4.x-java7 - Build # 1088 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-java7/1088/

2 tests failed.
REGRESSION:  org.apache.solr.update.SoftAutoCommitTest.testSoftAndHardCommitMaxTimeDelete

Error Message:
searcher529 wasn't soon enough after soft529: 1363915574324 !< 1363915574205 + 100 (fudge)

Stack Trace:
java.lang.AssertionError: searcher529 wasn't soon enough after soft529: 1363915574324 !< 1363915574205 + 100 (fudge)
	at __randomizedtesting.SeedInfo.seed([9A03EFD7AD17965C:5D4F574AB6BF5BEC]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.update.SoftAutoCommitTest.testSoftAndHardCommitMaxTimeDelete(SoftAutoCommitTest.java:265)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:601)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)


FAILED:  org.apache.solr.cloud.SyncSliceTest.testDistribSearch

Error Message:
Test Setup Failure: shard1 should have just been set up to be inconsistent - but it's still consistent. Leader:http://127.0.0.1:29291/collection1 Dead Guy:http://127.0.0.1:29281/collection1skip list:[CloudJettyRunner [url=http://127.0.0.1:29310/collection1], CloudJettyRunner [url=http://127.0.0.1:29310/collection1]]

Stack Trace:
java.lang.AssertionError: Test Setup Failure: shard1 should have just been set up to be inconsistent - but it's still consistent. Leader:http://127.0.0.1:29291/collection1 Dead Guy:http://127.0.0.1:29281/collection1skip list:[CloudJettyRunner [url=http://127.0.0.1:29310/collection1], CloudJettyRunner [url=http://127.0.0.1:29310/collection1]]
	at __randomizedtesting.SeedInfo.seed([9A03EFD7AD17965C:1BE561CFDA48F660]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNotNull(Assert.java:526)
	at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:212)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:601)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)




Build Log:
[...truncated 9034 lines...]
[junit4:junit4] Suite: org.apache.solr.update.SoftAutoCommitTest
[junit4:junit4]   2> 0 T113 oas.SolrTestCaseJ4.startTrackingSearchers WARNING startTrackingSearchers: numOpens=2 numCloses=2
[junit4:junit4]   2> 2 T113 oas.SolrTestCaseJ4.initCore ####initCore
[junit4:junit4]   2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./solrtest-SoftAutoCommitTest-1363915571369
[junit4:junit4]   2> 2 T113 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/'
[junit4:junit4]   2> 4 T113 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/lib/README' to classloader
[junit4:junit4]   2> 4 T113 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 90 T113 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4]   2> 196 T113 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 197 T113 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 210 T113 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 834 T113 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 846 T113 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 849 T113 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 866 T113 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 872 T113 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 876 T113 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 877 T113 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 878 T113 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 878 T113 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 879 T113 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 879 T113 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 880 T113 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 880 T113 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr
[junit4:junit4]   2> 880 T113 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/'
[junit4:junit4]   2> 893 T113 oasc.CoreContainer.<init> New CoreContainer 1085112373
[junit4:junit4]   2> 894 T113 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 895 T113 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./solrtest-SoftAutoCommitTest-1363915571369/
[junit4:junit4]   2> 895 T113 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2299e3c9
[junit4:junit4]   2> 896 T113 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 896 T113 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./solrtest-SoftAutoCommitTest-1363915571369
[junit4:junit4]   2> 897 T113 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./solrtest-SoftAutoCommitTest-1363915571369/index/
[junit4:junit4]   2> 897 T113 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./solrtest-SoftAutoCommitTest-1363915571369/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 899 T113 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./solrtest-SoftAutoCommitTest-1363915571369/index
[junit4:junit4]   2> 904 T113 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/index3941139413tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@2d7f6d79)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 905 T113 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 906 T113 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 908 T113 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 909 T113 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 909 T113 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 910 T113 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 910 T113 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 911 T113 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 911 T113 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 912 T113 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 912 T113 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 913 T113 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 914 T113 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 914 T113 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 915 T113 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 915 T113 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 915 T113 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 916 T113 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 917 T113 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 917 T113 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 918 T113 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 918 T113 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 919 T113 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 920 T113 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 920 T113 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 921 T113 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 921 T113 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 922 T113 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 933 T113 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 939 T113 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 941 T113 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [THROW.ERROR.ON.ADD.UPDATEPROCESSOR.JS, SOLRCONFIG-HIGHLIGHT.XML, SCHEMA-REQUIRED-FIELDS.XML, BAD-SCHEMA-DOCVALUES-NOT-REQUIRED-NO-DEFAULT.XML, SCHEMA-MINIMAL.XML, BAD-SCHEMA-DUP-DYNAMICFIELD.XML, SCHEMA-REPLICATION2.XML, TRIVIAL.UPDATEPROCESSOR1.JS, SOLRCONFIG-CACHING.XML, SCHEMA-POSTINGSHIGHLIGHT.XML, REGEX-BOOST-PROCESSOR-TEST.TXT, SOLRCONFIG-REPEATER.XML, BAD-SCHEMA-CURRENCY-FT-BOGUS-CODE-IN-XML.XML, BAD-SCHEMA-NONTEXT-ANALYZER.XML, CURRENCY.XML, SOLRCONFIG-MERGEPOLICY.XML, SOLRCONFIG-TLOG.XML, SOLRCONFIG-MASTER.XML, SOLRCONFIG-COMPONENTS-NAME.XML, BAD-SCHEMA-UNIQUEKEY-MULTIVALUED.XML, SCHEMA11.XML, SOLRCONFIG-BASIC.XML, DA_COMPOUNDDICTIONARY.TXT, MISSLEADING.EXTENSION.UPDATEPROCESSOR.JS.TXT, SCHEMA-COPYFIELD-TEST.XML, SOLRCONFIG-SLAVE.XML, ELEVATE.XML, SOLRCONFIG-PROPINJECT-INDEXDEFAULT.XML, TRIVIAL.UPDATEPROCESSOR0.JS, SCHEMA-SWEETSPOT.XML, BAD-SOLRCONFIG-BOGUS-SCRIPTENGINE-NAME.XML, SCHEMA-CHARFILTERS.XML, SCHEMA-IB.XML, SOLRCONFIG-QUERYSENDER.XML, SOLRCONFIG-SNIPPET-PROCESSOR.XML, SCHEMA-REPLICATION1.XML, DA_UTF8.XML, SCHEMA-TINY.XML, CONDITIONAL.UPDATEPROCESSOR.JS, MISSING.FUNCTIONS.UPDATEPROCESSOR.JS, HYPHENATION.DTD, SOLRCONFIG-ENABLEPLUGIN.XML, STEMDICT.TXT, SCHEMA-PHRASESUGGEST.XML, HUNSPELL-TEST.AFF, BAD-SCHEMA-CURRENCY-FT-OER-NORATES.XML, SCHEMA-SNIPPET-TYPE.XML, STOPTYPES-1.TXT, STOPWORDSWRONGENCODING.TXT, SCHEMA-NUMERIC.XML, SOLRCONFIG-TRANSFORMERS.XML, SOLRCONFIG-PROPINJECT.XML, BAD-SCHEMA-NOT-INDEXED-BUT-TF.XML, SOLRCONFIG-SIMPLELOCK.XML, SCHEMA-DOCVALUES.XML, WDFTYPES.TXT, STOPTYPES-2.TXT, SCHEMA-REVERSED.XML, BAD-SCHEMA-CURRENCY-FT-MULTIVALUED.XML, SOLRCONFIG-SPELLCHECKCOMPONENT.XML, SOLRCONFIG-PHRASESUGGEST.XML, SCHEMA-DFR.XML, BAD-SCHEMA-CURRENCY-MULTIVALUED.XML, BAD-SCHEMA-NOT-INDEXED-BUT-POS.XML, KEEP-1.TXT, OPEN-EXCHANGE-RATES.JSON, SCHEMA-SPATIAL.XML, STOPWITHBOM.TXT, SOLRCONFIG-POSTINGSHIGHLIGHT.XML, SCHEMA-BINARYFIELD.XML, SOLRCONFIG-SPELLCHECKER.XML, SOLRCONFIG-UPDATE-PROCESSOR-CHAINS.XML, BAD-SCHEMA-OMIT-TF-BUT-NOT-POS.XML, SCHEMA-XINCLUDE.XML, BAD-SCHEMA-DUP-FIELDTYPE.XML, SOLRCONFIG-MASTER1.XML, SCHEMA-BEHAVIOR.XML, SYNONYMS.TXT, SOLRCONFIG-MINIMAL.XML, SCHEMA-DOCVALUESMULTI.XML, BAD-SCHEMA-UNSUPPORTED-DOCVALUES.XML, BAD-SCHEMA-CURRENCY-DYNAMIC-MULTIVALUED.XML, SCHEMA_CODEC.XML, BAD-SCHEMA-SWEETSPOT-PARTIAL-HYPERBOLIC.XML, SOLRCONFIG-SOLR-749.XML, SOLRCONFIG-MASTER1-KEEPONEBACKUP.XML, SCHEMA-EFF.XML, STOP-2.TXT, SOLRCONFIG-FUNCTIONQUERY.XML, SCHEMA-LMDIRICHLET.XML, SOLRCONFIG-TERMINDEX.XML, SOLRCONFIG-ELEVATE.XML, BAD-SCHEMA-SWEETSPOT-PARTIAL-NORMS.XML, BAD-SCHEMA-SWEETSPOT-PARTIAL-BASELINE.XML, STOPWORDS.TXT, SCHEMA-FOLDING.XML, SCHEMA-STOP-KEEP.XML, FUZZYSUGGEST.TXT, BAD-SCHEMA-NOT-INDEXED-BUT-NORMS.XML, SCHEMA-REST.XML, SOLRCONFIG-SOLCOREPROPERTIES.XML, STOP-1.TXT, SOLRCONFIG-MASTER2.XML, SCHEMA-SPELLCHECKER.XML, SOLRCONFIG-RESPONSE-LOG-COMPONENT.XML, SOLRCONFIG-LAZYWRITER.XML, SCHEMA-LUCENEMATCHVERSION.XML, BAD-MP-SOLRCONFIG.XML, FRENCHARTICLES.TXT, SCHEMA15.XML, SOLRCONFIG-REQHANDLER.INCL, SCHEMASURROUND.XML, SCHEMA-COLLATEFILTER.XML, SOLRCONFIG-MASTER3.XML, HUNSPELL-TEST.DIC, SOLRCONFIG-XINCLUDE.XML, BAD-SCHEMA-CODEC-GLOBAL-VS-FT-MISMATCH.XML, SOLRCONFIG-SLAVE1.XML, SOLRCONFIG-DELPOLICY1.XML, SCHEMA-SIM.XML, SCHEMA-SNIPPET-FIELD.XML, SCHEMA-COLLATE.XML, STOP-SNOWBALL.TXT, BAD-SCHEMA-SIM-GLOBAL-VS-FT-MISMATCH.XML, PROTWORDS.TXT, SCHEMA-TRIE.XML, SOLRCONFIG_CODEC.XML, SCHEMA-SYNONYM-TOKENIZER.XML, BAD-SOLRCONFIG-INVALID-SCRIPTFILE.XML, JASUGGEST.TXT, SCHEMA-DOCVALUESFACETING.XML, SCHEMA-TFIDF.XML, SOLRCONFIG-SCRIPT-UPDATEPROCESSOR.XML, SCHEMA-LMJELINEKMERCER.XML, PHRASESUGGEST.TXT, BAD-SOLRCONFIG-MISSING-SCRIPTFILE.XML, SOLRCONFIG-BASIC-LUCENEVERSION31.XML, BAD-SCHEMA-UNIQUEKEY-USES-DEFAULT.XML, OLD_SYNONYMS.TXT, SOLRCONFIG-DELPOLICY2.XML, SOLRCONFIG-NATIVELOCK.XML, XSLT, BAD-SCHEMA-DUP-FIELD.XML, SOLRCONFIG-NOCACHE.XML, SCHEMA-BM25.XML, BAD-SCHEMA-SWEETSPOT-BOTH-TF.XML, ADDFIELDS.UPDATEPROCESSOR.JS, SOLRCONFIG-ALTDIRECTORY.XML, SOLRCONFIG-QUERYSENDER-NOQUERY.XML, COMPOUNDDICTIONARY.TXT, SOLRCONFIG-INDEXCONFIG.XML, SOLRCONFIG_PERF.XML, BAD-CURRENCY.XML, BAD-SCHEMA-CURRENCY-FT-BOGUS-DEFAULT-CODE.XML, BAD-SCHEMA-ANALYZER-CLASS-AND-NESTED.XML, SCHEMA-NOT-REQUIRED-UNIQUE-KEY.XML, KEEP-2.TXT, SCHEMA12.XML, BAD-SCHEMA-UNIQUEKEY-IS-COPYFIELD-DEST.XML, MAPPING-ISOLATIN1ACCENT.TXT, BAD_SOLRCONFIG.XML, BAD-SCHEMA-EXTERNAL-FILEFIELD.XML]
[junit4:junit4]   2> 945 T113 oass.SolrIndexSearcher.<init> Opening Searcher@553396b0 main
[junit4:junit4]   2> 946 T113 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 947 T113 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 947 T113 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 953 T113 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 1063 T114 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@553396b0 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 1084 T113 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 1098 T113 oas.SolrTestCaseJ4.initCore ####initCore end
[junit4:junit4]   2> 1103 T113 oas.SolrTestCaseJ4.setUp ###Starting testSoftAndHardCommitMaxTimeDelete
[junit4:junit4]   2> 1104 T113 oasc.CoreContainer.reload Reloading SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1
[junit4:junit4]   2> 1105 T113 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/'
[junit4:junit4]   2> 1106 T113 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/lib/README' to classloader
[junit4:junit4]   2> 1107 T113 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 1197 T113 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4]   2> 1280 T113 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 1282 T113 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 1297 T113 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 1984 T113 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 2000 T113 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 2004 T113 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 2026 T113 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 2033 T113 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 2038 T113 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 2039 T113 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 2039 T113 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 2040 T113 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 2041 T113 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 2041 T113 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 2042 T113 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./solrtest-SoftAutoCommitTest-1363915571369/
[junit4:junit4]   2> 2043 T113 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2299e3c9
[junit4:junit4]   2> 2044 T113 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./solrtest-SoftAutoCommitTest-1363915571369/index/
[junit4:junit4]   2> 2044 T113 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 2047 T113 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 2048 T113 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 2049 T113 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 2049 T113 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 2050 T113 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 2051 T113 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 2051 T113 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 2053 T113 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 2054 T113 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 2055 T113 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 2056 T113 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 2056 T113 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 2057 T113 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 2058 T113 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 2059 T113 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 2060 T113 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 2061 T113 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2062 T113 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2063 T113 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2064 T113 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2065 T113 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2066 T113 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2067 T113 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2068 T113 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2069 T113 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 2070 T113 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 2072 T113 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 2074 T113 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 2077 T113 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [THROW.ERROR.ON.ADD.UPDATEPROCESSOR.JS, SOLRCONFIG-HIGHLIGHT.XML, SCHEMA-REQUIRED-FIELDS.XML, BAD-SCHEMA-DOCVALUES-NOT-REQUIRED-NO-DEFAULT.XML, SCHEMA-MINIMAL.XML, BAD-SCHEMA-DUP-DYNAMICFIELD.XML, SCHEMA-REPLICATION2.XML, TRIVIAL.UPDATEPROCESSOR1.JS, SOLRCONFIG-CACHING.XML, SCHEMA-POSTINGSHIGHLIGHT.XML, REGEX-BOOST-PROCESSOR-TEST.TXT, SOLRCONFIG-REPEATER.XML, BAD-SCHEMA-CURRENCY-FT-BOGUS-CODE-IN-XML.XML, BAD-SCHEMA-NONTEXT-ANALYZER.XML, CURRENCY.XML, SOLRCONFIG-MERGEPOLICY.XML, SOLRCONFIG-TLOG.XML, SOLRCONFIG-MASTER.XML, SOLRCONFIG-COMPONENTS-NAME.XML, BAD-SCHEMA-UNIQUEKEY-MULTIVALUED.XML, SCHEMA11.XML, SOLRCONFIG-BASIC.XML, DA_COMPOUNDDICTIONARY.TXT, MISSLEADING.EXTENSION.UPDATEPROCESSOR.JS.TXT, SCHEMA-COPYFIELD-TEST.XML, SOLRCONFIG-SLAVE.XML, ELEVATE.XML, SOLRCONFIG-PROPINJECT-INDEXDEFAULT.XML, TRIVIAL.UPDATEPROCESSOR0.JS, SCHEMA-SWEETSPOT.XML, BAD-SOLRCONFIG-BOGUS-SCRIPTENGINE-NAME.XML, SCHEMA-CHARFILTERS.XML, SCHEMA-IB.XML, SOLRCONFIG-QUERYSENDER.XML, SOLRCONFIG-SNIPPET-PROCESSOR.XML, SCHEMA-REPLICATION1.XML, DA_UTF8.XML, SCHEMA-TINY.XML, CONDITIONAL.UPDATEPROCESSOR.JS, MISSING.FUNCTIONS.UPDATEPROCESSOR.JS, HYPHENATION.DTD, SOLRCONFIG-ENABLEPLUGIN.XML, STEMDICT.TXT, SCHEMA-PHRASESUGGEST.XML, HUNSPELL-TEST.AFF, BAD-SCHEMA-CURRENCY-FT-OER-NORATES.XML, SCHEMA-SNIPPET-TYPE.XML, STOPTYPES-1.TXT, STOPWORDSWRONGENCODING.TXT, SCHEMA-NUMERIC.XML, SOLRCONFIG-TRANSFORMERS.XML, SOLRCONFIG-PROPINJECT.XML, BAD-SCHEMA-NOT-INDEXED-BUT-TF.XML, SOLRCONFIG-SIMPLELOCK.XML, SCHEMA-DOCVALUES.XML, WDFTYPES.TXT, STOPTYPES-2.TXT, SCHEMA-REVERSED.XML, BAD-SCHEMA-CURRENCY-FT-MULTIVALUED.XML, SOLRCONFIG-SPELLCHECKCOMPONENT.XML, SOLRCONFIG-PHRASESUGGEST.XML, SCHEMA-DFR.XML, BAD-SCHEMA-CURRENCY-MULTIVALUED.XML, BAD-SCHEMA-NOT-INDEXED-BUT-POS.XML, KEEP-1.TXT, OPEN-EXCHANGE-RATES.JSON, SCHEMA-SPATIAL.XML, STOPWITHBOM.TXT, SOLRCONFIG-POSTINGSHIGHLIGHT.XML, SCHEMA-BINARYFIELD.XML, SOLRCONFIG-SPELLCHECKER.XML, SOLRCONFIG-UPDATE-PROCESSOR-CHAINS.XML, BAD-SCHEMA-OMIT-TF-BUT-NOT-POS.XML, SCHEMA-XINCLUDE.XML, BAD-SCHEMA-DUP-FIELDTYPE.XML, SOLRCONFIG-MASTER1.XML, SCHEMA-BEHAVIOR.XML, SYNONYMS.TXT, SOLRCONFIG-MINIMAL.XML, SCHEMA-DOCVALUESMULTI.XML, BAD-SCHEMA-UNSUPPORTED-DOCVALUES.XML, BAD-SCHEMA-CURRENCY-DYNAMIC-MULTIVALUED.XML, SCHEMA_CODEC.XML, BAD-SCHEMA-SWEETSPOT-PARTIAL-HYPERBOLIC.XML, SOLRCONFIG-SOLR-749.XML, SOLRCONFIG-MASTER1-KEEPONEBACKUP.XML, SCHEMA-EFF.XML, STOP-2.TXT, SOLRCONFIG-FUNCTIONQUERY.XML, SCHEMA-LMDIRICHLET.XML, SOLRCONFIG-TERMINDEX.XML, SOLRCONFIG-ELEVATE.XML, BAD-SCHEMA-SWEETSPOT-PARTIAL-NORMS.XML, BAD-SCHEMA-SWEETSPOT-PARTIAL-BASELINE.XML, STOPWORDS.TXT, SCHEMA-FOLDING.XML, SCHEMA-STOP-KEEP.XML, FUZZYSUGGEST.TXT, BAD-SCHEMA-NOT-INDEXED-BUT-NORMS.XML, SCHEMA-REST.XML, SOLRCONFIG-SOLCOREPROPERTIES.XML, STOP-1.TXT, SOLRCONFIG-MASTER2.XML, SCHEMA-SPELLCHECKER.XML, SOLRCONFIG-RESPONSE-LOG-COMPONENT.XML, SOLRCONFIG-LAZYWRITER.XML, SCHEMA-LUCENEMATCHVERSION.XML, BAD-MP-SOLRCONFIG.XML, FRENCHARTICLES.TXT, SCHEMA15.XML, SOLRCONFIG-REQHANDLER.INCL, SCHEMASURROUND.XML, SCHEMA-COLLATEFILTER.XML, SOLRCONFIG-MASTER3.XML, HUNSPELL-TEST.DIC, SOLRCONFIG-XINCLUDE.XML, BAD-SCHEMA-CODEC-GLOBAL-VS-FT-MISMATCH.XML, SOLRCONFIG-SLAVE1.XML, SOLRCONFIG-DELPOLICY1.XML, SCHEMA-SIM.XML, SCHEMA-SNIPPET-FIELD.XML, SCHEMA-COLLATE.XML, STOP-SNOWBALL.TXT, BAD-SCHEMA-SIM-GLOBAL-VS-FT-MISMATCH.XML, PROTWORDS.TXT, SCHEMA-TRIE.XML, SOLRCONFIG_CODEC.XML, SCHEMA-SYNONYM-TOKENIZER.XML, BAD-SOLRCONFIG-INVALID-SCRIPTFILE.XML, JASUGGEST.TXT, SCHEMA-DOCVALUESFACETING.XML, SCHEMA-TFIDF.XML, SOLRCONFIG-SCRIPT-UPDATEPROCESSOR.XML, SCHEMA-LMJELINEKMERCER.XML, PHRASESUGGEST.TXT, BAD-SOLRCONFIG-MISSING-SCRIPTFILE.XML, SOLRCONFIG-BASIC-LUCENEVERSION31.XML, BAD-SCHEMA-UNIQUEKEY-USES-DEFAULT.XML, OLD_SYNONYMS.TXT, SOLRCONFIG-DELPOLICY2.XML, SOLRCONFIG-NATIVELOCK.XML, XSLT, BAD-SCHEMA-DUP-FIELD.XML, SOLRCONFIG-NOCACHE.XML, SCHEMA-BM25.XML, BAD-SCHEMA-SWEETSPOT-BOTH-TF.XML, ADDFIELDS.UPDATEPROCESSOR.JS, SOLRCONFIG-ALTDIRECTORY.XML, SOLRCONFIG-QUERYSENDER-NOQUERY.XML, COMPOUNDDICTIONARY.TXT, SOLRCONFIG-INDEXCONFIG.XML, SOLRCONFIG_PERF.XML, BAD-CURRENCY.XML, BAD-SCHEMA-CURRENCY-FT-BOGUS-DEFAULT-CODE.XML, BAD-SCHEMA-ANALYZER-CLASS-AND-NESTED.XML, SCHEMA-NOT-REQUIRED-UNIQUE-KEY.XML, KEEP-2.TXT, SCHEMA12.XML, BAD-SCHEMA-UNIQUEKEY-IS-COPYFIELD-DEST.XML, MAPPING-ISOLATIN1ACCENT.TXT, BAD_SOLRCONFIG.XML, BAD-SCHEMA-EXTERNAL-FILEFIELD.XML]
[junit4:junit4]   2> 2082 T113 oass.SolrIndexSearcher.<init> Opening Searcher@303e683f main
[junit4:junit4]   2> 2083 T113 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 2084 T113 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 2085 T113 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 2088 T113 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 2109 T115 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@303e683f main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 2120 T113 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 2121 T113 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 2125 T113 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/index3941139413tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@2d7f6d79)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 2125 T113 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 2126 T113 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 2127 T113 oass.SolrIndexSearcher.<init> Opening Searcher@ca2394c main
[junit4:junit4]   2> 2128 T113 oasc.CoreContainer.registerCore replacing core: collection1
[junit4:junit4]   2> 2128 T113 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@3ebc38bf
[junit4:junit4]   2> 2130 T115 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@ca2394c main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4:junit4]   2> 2138 T113 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 2139 T113 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4]   2> ASYNC  NEW_CORE C4 name=collection1 org.apache.solr.core.SolrCore@3d8fe9b5
[junit4:junit4]   2> 2153 T113 C4 UPDATE [collection1] webapp=null path=null params={} {add=[529]} 0 5
[junit4:junit4]   2> 2167 T113 C4 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 2230 T113 C4 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/index3941139413tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@2d7f6d79)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/index3941139413tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@2d7f6d79)),segFN=segments_2,generation=2,filenames=[_0.fnm, _0.pos, _0.tim, _0.nvd, segments_2, _0.fdx, _0.si, _0.nvm, _0.doc, _0.tip, _0.fdt]
[junit4:junit4]   2> 2231 T113 C4 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[_0.fnm, _0.pos, _0.tim, _0.nvd, segments_2, _0.fdx, _0.si, _0.nvm, _0.doc, _0.tip, _0.fdt]
[junit4:junit4]   2> 2323 T113 C4 oass.SolrIndexSearcher.<init> Opening Searcher@3b3a0d10 main
[junit4:junit4]   2> 2323 T113 C4 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 2325 T115 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3b3a0d10 main{StandardDirectoryReader(segments_2:3:nrt _0(4.3):C1)}
[junit4:junit4]   2> 2326 T113 C4 UPDATE [collection1] webapp=null path=null params={} {commit=} 0 159
[junit4:junit4]   2> 2335 T113 C4 UPDATE [collection1] webapp=null path=null params={} {delete=[529]} 0 0
[junit4:junit4]   2> 2838 T117 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
[junit4:junit4]   2> 2957 T117 oass.SolrIndexSearcher.<init> Opening Searcher@7f6e8cd main
[junit4:junit4]   2> 2957 T117 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 2959 T115 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7f6e8cd main{StandardDirectoryReader(segments_2:5:nrt)}
[junit4:junit4]   2> 2970 T113 C4 UPDATE [collection1] webapp=null path=null params={} {add=[550]} 0 4
[junit4:junit4]   2> 3471 T117 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
[junit4:junit4]   2> 3512 T117 oass.SolrIndexSearcher.<init> Opening Searcher@7a456c2b main
[junit4:junit4]   2> 3513 T117 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 3514 T115 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7a456c2b main{StandardDirectoryReader(segments_2:7:nrt _1(4.3):C1)}
[junit4:junit4]   2> 3548 T116 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 3584 T116 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/index3941139413tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@2d7f6d79)),segFN=segments_2,generation=2,filenames=[_0.fnm, _0.pos, _0.tim, _0.nvd, segments_2, _0.fdx, _0.si, _0.nvm, _0.doc, _0.tip, _0.fdt]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/index3941139413tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@2d7f6d79)),segFN=segments_3,generation=3,filenames=[_1.doc, _1.fdx, _1.nvm, _1.fdt, _1.pos, _1.si, _1.nvd, _1.tip, _1.fnm, _1.tim, segments_3]
[junit4:junit4]   2> 3585 T116 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[_1.doc, _1.fdx, _1.nvm, _1.fdt, _1.pos, _1.si, _1.nvd, _1.tip, _1.fnm, _1.tim, segments_3]
[junit4:junit4]   2> 3589 T116 oass.SolrIndexSearcher.<init> Opening Searcher@49274416 main
[junit4:junit4]   2> 3589 T113 oas.SolrTestCaseJ4.tearDown ###Ending testSoftAndHardCommitMaxTimeDelete
[junit4:junit4]   2> 3589 T116 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 3591 T115 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@49274416 main{StandardDirectoryReader(segments_2:7:nrt _1(4.3):C1)}
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=SoftAutoCommitTest -Dtests.method=testSoftAndHardCommitMaxTimeDelete -Dtests.seed=9A03EFD7AD17965C -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=pt_BR -Dtests.timezone=Antarctica/Syowa -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] FAILURE 2.73s J0 | SoftAutoCommitTest.testSoftAndHardCommitMaxTimeDelete <<<
[junit4:junit4]    > Throwable #1: java.lang.AssertionError: searcher529 wasn't soon enough after soft529: 1363915574324 !< 1363915574205 + 100 (fudge)
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([9A03EFD7AD17965C:5D4F574AB6BF5BEC]:0)
[junit4:junit4]    > 	at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4]    > 	at org.junit.Assert.assertTrue(Assert.java:43)
[junit4:junit4]    > 	at org.apache.solr.update.SoftAutoCommitTest.testSoftAndHardCommitMaxTimeDelete(SoftAutoCommitTest.java:265)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:601)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 3861 T113 oas.SolrTestCaseJ4.setUp ###Starting testSoftAndHardCommitMaxTimeMixedAdds
[junit4:junit4]   2> 3861 T113 oasc.CoreContainer.reload Reloading SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1
[junit4:junit4]   2> 3862 T113 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/'
[junit4:junit4]   2> 3863 T113 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/lib/README' to classloader
[junit4:junit4]   2> 3864 T113 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 3946 T113 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4]   2> 4003 T113 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 4004 T113 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 4013 T113 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 4665 T113 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 4677 T113 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 4681 T113 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 4697 T113 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 4702 T113 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 4706 T113 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 4707 T113 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 4708 T113 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 4708 T113 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 4709 T113 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 4709 T113 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 4710 T113 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./solrtest-SoftAutoCommitTest-1363915571369/
[junit4:junit4]   2> 4710 T113 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2299e3c9
[junit4:junit4]   2> 4711 T113 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./solrtest-SoftAutoCommitTest-1363915571369/index/
[junit4:junit4]   2> 4711 T113 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 4713 T113 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 4714 T113 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 4714 T113 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 4715 T113 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 4715 T113 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 4716 T113 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 4716 T113 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 4717 T113 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 4717 T113 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 4718 T113 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 4719 T113 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 4719 T113 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 4720 T113 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 4720 T113 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 4721 T113 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 4722 T113 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 4722 T113 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4723 T113 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4724 T113 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4725 T113 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4726 T113 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4727 T113 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4728 T113 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4729 T113 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4730 T113 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 4731 T113 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 4742 T113 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 4744 T113 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 4746 T113 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [THROW.ERROR.ON.ADD.UPDATEPROCESSOR.JS, SOLRCONFIG-HIGHLIGHT.XML, SCHEMA-REQUIRED-FIELDS.XML, BAD-SCHEMA-DOCVALUES-NOT-REQUIRED-NO-DEFAULT.XML, SCHEMA-MINIMAL.XML, BAD-SCHEMA-DUP-DYNAMICFIELD.XML, SCHEMA-REPLICATION2.XML, TRIVIAL.UPDATEPROCESSOR1.JS, SOLRCONFIG-CACHING.XML, SCHEMA-POSTINGSHIGHLIGHT.XML, REGEX-BOOST-PROCESSOR-TEST.TXT, SOLRCONFIG-REPEATER.XML, BAD-SCHEMA-CURRENCY-FT-BOGUS-CODE-IN-XML.XML, BAD-SCHEMA-NONTEXT-ANALYZER.XML, CURRENCY.XML, SOLRCONFIG-MERGEPOLICY.XML, SOLRCONFIG-TLOG.XML, SOLRCONFIG-MASTER.XML, SOLRCONFIG-COMPONENTS-NAME.XML, BAD-SCHEMA-UNIQUEKEY-MULTIVALUED.XML, SCHEMA11.XML, SOLRCONFIG-BASIC.XML, DA_COMPOUNDDICTIONARY.TXT, MISSLEADING.EXTENSION.UPDATEPROCESSOR.JS.TXT, SCHEMA-COPYFIELD-TEST.XML, SOLRCONFIG-SLAVE.XML, ELEVATE.XML, SOLRCONFIG-PROPINJECT-INDEXDEFAULT.XML, TRIVIAL.UPDATEPROCESSOR0.JS, SCHEMA-SWEETSPOT.XML, BAD-SOLRCONFIG-BOGUS-SCRIPTENGINE-NAME.XML, SCHEMA-CHARFILTERS.XML, SCHEMA-IB.XML, SOLRCONFIG-QUERYSENDER.XML, SOLRCONFIG-SNIPPET-PROCESSOR.XML, SCHEMA-REPLICATION1.XML, DA_UTF8.XML, SCHEMA-TINY.XML, CONDITIONAL.UPDATEPROCESSOR.JS, MISSING.FUNCTIONS.UPDATEPROCESSOR.JS, HYPHENATION.DTD, SOLRCONFIG-ENABLEPLUGIN.XML, STEMDICT.TXT, SCHEMA-PHRASESUGGEST.XML, HUNSPELL-TEST.AFF, BAD-SCHEMA-CURRENCY-FT-OER-NORATES.XML, SCHEMA-SNIPPET-TYPE.XML, STOPTYPES-1.TXT, STOPWORDSWRONGENCODING.TXT, SCHEMA-NUMERIC.XML, SOLRCONFIG-TRANSFORMERS.XML, SOLRCONFIG-PROPINJECT.XML, BAD-SCHEMA-NOT-INDEXED-BUT-TF.XML, SOLRCONFIG-SIMPLELOCK.XML, SCHEMA-DOCVALUES.XML, WDFTYPES.TXT, STOPTYPES-2.TXT, SCHEMA-REVERSED.XML, BAD-SCHEMA-CURRENCY-FT-MULTIVALUED.XML, SOLRCONFIG-SPELLCHECKCOMPONENT.XML, SOLRCONFIG-PHRASESUGGEST.XML, SCHEMA-DFR.XML, BAD-SCHEMA-CURRENCY-MULTIVALUED.XML, BAD-SCHEMA-NOT-INDEXED-BUT-POS.XML, KEEP-1.TXT, OPEN-EXCHANGE-RATES.JSON, SCHEMA-SPATIAL.XML, STOPWITHBOM.TXT, SOLRCONFIG-POSTINGSHIGHLIGHT.XML, SCHEMA-BINARYFIELD.XML, SOLRCONFIG-SPELLCHECKER.XML, SOLRCONFIG-UPDATE-PROCESSOR-CHAINS.XML, BAD-SCHEMA-OMIT-TF-BUT-NOT-POS.XML, SCHEMA-XINCLUDE.XML, BAD-SCHEMA-DUP-FIELDTYPE.XML, SOLRCONFIG-MASTER1.XML, SCHEMA-BEHAVIOR.XML, SYNONYMS.TXT, SOLRCONFIG-MINIMAL.XML, SCHEMA-DOCVALUESMULTI.XML, BAD-SCHEMA-UNSUPPORTED-DOCVALUES.XML, BAD-SCHEMA-CURRENCY-DYNAMIC-MULTIVALUED.XML, SCHEMA_CODEC.XML, BAD-SCHEMA-SWEETSPOT-PARTIAL-HYPERBOLIC.XML, SOLRCONFIG-SOLR-749.XML, SOLRCONFIG-MASTER1-KEEPONEBACKUP.XML, SCHEMA-EFF.XML, STOP-2.TXT, SOLRCONFIG-FUNCTIONQUERY.XML, SCHEMA-LMDIRICHLET.XML, SOLRCONFIG-TERMINDEX.XML, SOLRCONFIG-ELEVATE.XML, BAD-SCHEMA-SWEETSPOT-PARTIAL-NORMS.XML, BAD-SCHEMA-SWEETSPOT-PARTIAL-BASELINE.XML, STOPWORDS.TXT, SCHEMA-FOLDING.XML, SCHEMA-STOP-KEEP.XML, FUZZYSUGGEST.TXT, BAD-SCHEMA-NOT-INDEXED-BUT-NORMS.XML, SCHEMA-REST.XML, SOLRCONFIG-SOLCOREPROPERTIES.XML, STOP-1.TXT, SOLRCONFIG-MASTER2.XML, SCHEMA-SPELLCHECKER.XML, SOLRCONFIG-RESPONSE-LOG-COMPONENT.XML, SOLRCONFIG-LAZYWRITER.XML, SCHEMA-LUCENEMATCHVERSION.XML, BAD-MP-SOLRCONFIG.XML, FRENCHARTICLES.TXT, SCHEMA15.XML, SOLRCONFIG-REQHANDLER.INCL, SCHEMASURROUND.XML, SCHEMA-COLLATEFILTER.XML, SOLRCONFIG-MASTER3.XML, HUNSPELL-TEST.DIC, SOLRCONFIG-XINCLUDE.XML, BAD-SCHEMA-CODEC-GLOBAL-VS-FT-MISMATCH.XML, SOLRCONFIG-SLAVE1.XML, SOLRCONFIG-DELPOLICY1.XML, SCHEMA-SIM.XML, SCHEMA-SNIPPET-FIELD.XML, SCHEMA-COLLATE.XML, STOP-SNOWBALL.TXT, BAD-SCHEMA-SIM-GLOBAL-VS-FT-MISMATCH.XML, PROTWORDS.TXT, SCHEMA-TRIE.XML, SOLRCONFIG_CODEC.XML, SCHEMA-SYNONYM-TOKENIZER.XML, BAD-SOLRCONFIG-INVALID-SCRIPTFILE.XML, JASUGGEST.TXT, SCHEMA-DOCVALUESFACETING.XML, SCHEMA-TFIDF.XML, SOLRCONFIG-SCRIPT-UPDATEPROCESSOR.XML, SCHEMA-LMJELINEKMERCER.XML, PHRASESUGGEST.TXT, BAD-SOLRCONFIG-MISSING-SCRIPTFILE.XML, SOLRCONFIG-BASIC-LUCENEVERSION31.XML, BAD-SCHEMA-UNIQUEKEY-USES-DEFAULT.XML, OLD_SYNONYMS.TXT, SOLRCONFIG-DELPOLICY2.XML, SOLRCONFIG-NATIVELOCK.XML, XSLT, BAD-SCHEMA-DUP-FIELD.XML, SOLRCONFIG-NOCACHE.XML, SCHEMA-BM25.XML, BAD-SCHEMA-SWEETSPOT-BOTH-TF.XML, ADDFIELDS.UPDATEPROCESSOR.JS, SOLRCONFIG-ALTDIRECTORY.XML, SOLRCONFIG-QUERYSENDER-NOQUERY.XML, COMPOUNDDICTIONARY.TXT, SOLRCONFIG-INDEXCONFIG.XML, SOLRCONFIG_PERF.XML, BAD-CURRENCY.XML, BAD-SCHEMA-CURRENCY-FT-BOGUS-DEFAULT-CODE.XML, BAD-SCHEMA-ANALYZER-CLASS-AND-NESTED.XML, SCHEMA-NOT-REQUIRED-UNIQUE-KEY.XML, KEEP-2.TXT, SCHEMA12.XML, BAD-SCHEMA-UNIQUEKEY-IS-COPYFIELD-DEST.XML, MAPPING-ISOLATIN1ACCENT.TXT, BAD_SOLRCONFIG.XML, BAD-SCHEMA-EXTERNAL-FILEFIELD.XML]
[junit4:junit4]   2> 4752 T113 oass.SolrIndexSearcher.<init> Opening Searcher@74646217 main
[junit4:junit4]   2> 4752 T113 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 4753 T113 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 4753 T113 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 4756 T113 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 4771 T118 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@74646217 main{StandardDirectoryReader(segments_3:7:nrt _1(4.3):C1)}
[junit4:junit4]   2> 4779 T113 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 4779 T113 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 4779 T113 oasu.DefaultSolrCoreState.newIndexWriter Closing old IndexWriter... core=collection1
[junit4:junit4]   2> 4787 T113 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/index3941139413tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@2d7f6d79)),segFN=segments_3,generation=3,filenames=[_1.doc, _1.nvm, _1.fdx, _1.pos, _1.fdt, _1.si, _1.nvd, _1.fnm, _1.tip, _1.tim, segments_3]
[junit4:junit4]   2> 4787 T113 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[_1.doc, _1.nvm, _1.fdx, _1.pos, _1.fdt, _1.si, _1.nvd, _1.fnm, _1.tip, _1.tim, segments_3]
[junit4:junit4]   2> 4787 T113 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 4790 T113 oass.SolrIndexSearcher.<init> Opening Searcher@712f15db main
[junit4:junit4]   2> 4791 T113 oasc.CoreContainer.registerCore replacing core: collection1
[junit4:junit4]   2> 4791 T113 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@3d8fe9b5
[junit4:junit4]   2> 4792 T118 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@712f15db main{StandardDirectoryReader(segments_3:7:nrt _1(4.3):C1)}
[junit4:junit4]   2> 4798 T113 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=4,autocommit maxTime=1200ms,autocommits=1,soft autocommit maxTime=500ms,soft autocommits=2,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=2,cumulative_deletesById=1,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 4799 T113 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4]   2> ASYNC  NEW_CORE C5 name=collection1 org.apache.solr.core.SolrCore@1a71fa61
[junit4:junit4]   2> 4811 T113 C5 UPDATE [collection1] webapp=null path=null params={} {add=[529]} 0 4
[junit4:junit4]   2> 5312 T120 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
[junit4:junit4]   2> 5330 T120 oass.SolrIndexSearcher.<init> Opening Searcher@512dcf64 main
[junit4:junit4]   2> 5331 T120 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 5333 T118 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@512dcf64 main{StandardDirectoryReader(segments_3:9:nrt _1(4.3):C1 _2(4.3):C1)}
[junit4:junit4]   2> 5344 T113 C5 UPDATE [collection1] webapp=null path=null params={} {add=[530]} 0 4
[junit4:junit4]   2> 5845 T120 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
[junit4:junit4]   2> 5858 T120 oass.SolrIndexSearcher.<init> Opening Searcher@2c957974 main
[junit4:junit4]   2> 5858 T120 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 5861 T118 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2c957974 main{StandardDirectoryReader(segments_3:11:nrt _1(4.3):C1 _2(4.3):C1 _3(4.3):C1)}
[junit4:junit4]   2> 6012 T119 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 6111 T119 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/index3941139413tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@2d7f6d79)),segFN=segments_3,generation=3,filenames=[_1.doc, _1.nvm, _1.fdx, _1.pos, _1.fdt, _1.si, _1.nvd, _1.fnm, _1.tip, _1.tim, segments_3]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/index3941139413tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@2d7f6d79)),segFN=segments_4,generation=4,filenames=[_2.pos, _1.doc, _2.si, _3.tim, _3.fdt, _3.pos, _3.fnm, _1.fnm, _2.doc, _2.tim, _3.nvd, _1.pos, _3.nvm, _1.tip, _1.tim, _1.nvm, _1.nvd, _3.doc, _2.fdt, _2.fdx, _2.fnm, _3.fdx, _1.fdx, _2.tip, _2.nvm, _1.fdt, _1.si, _2.nvd, _3.si, _3.tip, segments_4]
[junit4:junit4]   2> 6111 T119 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[_2.pos, _1.doc, _2.si, _3.tim, _3.fdt, _3.pos, _3.fnm, _1.fnm, _2.doc, _2.tim, _3.nvd, _1.pos, _3.nvm, _1.tip, _1.tim, _1.nvm, _1.nvd, _3.doc, _2.fdt, _2.fdx, _2.fnm, _3.fdx, _1.fdx, _2.tip, _2.nvm, _1.fdt, _1.si, _2.nvd, _3.si, _3.tip, segments_4]
[junit4:junit4]   2> 6112 T119 oass.SolrIndexSearcher.<init> Opening Searcher@389bc998 main
[junit4:junit4]   2> 6112 T119 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 6114 T118 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@389bc998 main{StandardDirectoryReader(segments_3:11:nrt _1(4.3):C1 _2(4.3):C1 _3(4.3):C1)}
[junit4:junit4]   2> 9314 T113 oas.SolrTestCaseJ4.tearDown ###Ending testSoftAndHardCommitMaxTimeMixedAdds
[junit4:junit4]   2> 9322 T113 oas.SolrTestCaseJ4.setUp ###Starting testSoftAndHardCommitMaxTimeRapidAdds
[junit4:junit4]   2> 9322 T113 oasc.CoreContainer.reload Reloading SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1
[junit4:junit4]   2> 9323 T113 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/'
[junit4:junit4]   2> 9325 T113 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/lib/README' to classloader
[junit4:junit4]   2> 9326 T113 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 9418 T113 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4]   2> 9514 T113 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 9515 T113 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 9525 T113 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 10174 T113 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 10187 T113 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 10192 T113 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 10211 T113 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 10217 T113 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 10222 T113 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 10223 T113 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 10224 T113 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 10224 T113 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 10225 T113 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 10226 T113 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 10226 T113 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./solrtest-SoftAutoCommitTest-1363915571369/
[junit4:junit4]   2> 10227 T113 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2299e3c9
[junit4:junit4]   2> 10228 T113 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./solrtest-SoftAutoCommitTest-1363915571369/index/
[junit4:junit4]   2> 10228 T113 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 10231 T113 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 10232 T113 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 10232 T113 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 10233 T113 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 10234 T113 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 10234 T113 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 10235 T113 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 10236 T113 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 10237 T113 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 10238 T113 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 10239 T113 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 10240 T113 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 10240 T113 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 10241 T113 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 10242 T113 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 10243 T113 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 10244 T113 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 10245 T113 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 10245 T113 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 10246 T113 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 10247 T113 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 10248 T113 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 10249 T113 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 10250 T113 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 10251 T113 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 10252 T113 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 10264 T113 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 10268 T113 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 10271 T113 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [THROW.ERROR.ON.ADD.UPDATEPROCESSOR.JS, SOLRCONFIG-HIGHLIGHT.XML, SCHEMA-REQUIRED-FIELDS.XML, BAD-SCHEMA-DOCVALUES-NOT-REQUIRED-NO-DEFAULT.XML, SCHEMA-MINIMAL.XML, BAD-SCHEMA-DUP-DYNAMICFIELD.XML, SCHEMA-REPLICATION2.XML, TRIVIAL.UPDATEPROCESSOR1.JS, SOLRCONFIG-CACHING.XML, SCHEMA-POSTINGSHIGHLIGHT.XML, REGEX-BOOST-PROCESSOR-TEST.TXT, SOLRCONFIG-REPEATER.XML, BAD-SCHEMA-CURRENCY-FT-BOGUS-CODE-IN-XML.XML, BAD-SCHEMA-NONTEXT-ANALYZER.XML, CURRENCY.XML, SOLRCONFIG-MERGEPOLICY.XML, SOLRCONFIG-TLOG.XML, SOLRCONFIG-MASTER.XML, SOLRCONFIG-COMPONENTS-NAME.XML, BAD-SCHEMA-UNIQUEKEY-MULTIVALUED.XML, SCHEMA11.XML, SOLRCONFIG-BASIC.XML, DA_COMPOUNDDICTIONARY.TXT, MISSLEADING.EXTENSION.UPDATEPROCESSOR.JS.TXT, SCHEMA-COPYFIELD-TEST.XML, SOLRCONFIG-SLAVE.XML, ELEVATE.XML, SOLRCONFIG-PROPINJECT-INDEXDEFAULT.XML, TRIVIAL.UPDATEPROCESSOR0.JS, SCHEMA-SWEETSPOT.XML, BAD-SOLRCONFIG-BOGUS-SCRIPTENGINE-NAME.XML, SCHEMA-CHARFILTERS.XML, SCHEMA-IB.XML, SOLRCONFIG-QUERYSENDER.XML, SOLRCONFIG-SNIPPET-PROCESSOR.XML, SCHEMA-REPLICATION1.XML, DA_UTF8.XML, SCHEMA-TINY.XML, CONDITIONAL.UPDATEPROCESSOR.JS, MISSING.FUNCTIONS.UPDATEPROCESSOR.JS, HYPHENATION.DTD, SOLRCONFIG-ENABLEPLUGIN.XML, STEMDICT.TXT, SCHEMA-PHRASESUGGEST.XML, HUNSPELL-TEST.AFF, BAD-SCHEMA-CURRENCY-FT-OER-NORATES.XML, SCHEMA-SNIPPET-TYPE.XML, STOPTYPES-1.TXT, STOPWORDSWRONGENCODING.TXT, SCHEMA-NUMERIC.XML, SOLRCONFIG-TRANSFORMERS.XML, SOLRCONFIG-PROPINJECT.XML, BAD-SCHEMA-NOT-INDEXED-BUT-TF.XML, SOLRCONFIG-SIMPLELOCK.XML, SCHEMA-DOCVALUES.XML, WDFTYPES.TXT, STOPTYPES-2.TXT, SCHEMA-REVERSED.XML, BAD-SCHEMA-CURRENCY-FT-MULTIVALUED.XML, SOLRCONFIG-SPELLCHECKCOMPONENT.XML, SOLRCONFIG-PHRASESUGGEST.XML, SCHEMA-DFR.XML, BAD-SCHEMA-CURRENCY-MULTIVALUED.XML, BAD-SCHEMA-NOT-INDEXED-BUT-POS.XML, KEEP-1.TXT, OPEN-EXCHANGE-RATES.JSON, SCHEMA-SPATIAL.XML, STOPWITHBOM.TXT, SOLRCONFIG-POSTINGSHIGHLIGHT.XML, SCHEMA-BINARYFIELD.XML, SOLRCONFIG-SPELLCHECKER.XML, SOLRCONFIG-UPDATE-PROCESSOR-CHAINS.XML, BAD-SCHEMA-OMIT-TF-BUT-NOT-POS.XML, SCHEMA-XINCLUDE.XML, BAD-SCHEMA-DUP-FIELDTYPE.XML, SOLRCONFIG-MASTER1.XML, SCHEMA-BEHAVIOR.XML, SYNONYMS.TXT, SOLRCONFIG-MINIMAL.XML, SCHEMA-DOCVALUESMULTI.XML, BAD-SCHEMA-UNSUPPORTED-DOCVALUES.XML, BAD-SCHEMA-CURRENCY-DYNAMIC-MULTIVALUED.XML, SCHEMA_CODEC.XML, BAD-SCHEMA-SWEETSPOT-PARTIAL-HYPERBOLIC.XML, SOLRCONFIG-SOLR-749.XML, SOLRCONFIG-MASTER1-KEEPONEBACKUP.XML, SCHEMA-EFF.XML, STOP-2.TXT, SOLRCONFIG-FUNCTIONQUERY.XML, SCHEMA-LMDIRICHLET.XML, SOLRCONFIG-TERMINDEX.XML, SOLRCONFIG-ELEVATE.XML, BAD-SCHEMA-SWEETSPOT-PARTIAL-NORMS.XML, BAD-SCHEMA-SWEETSPOT-PARTIAL-BASELINE.XML, STOPWORDS.TXT, SCHEMA-FOLDING.XML, SCHEMA-STOP-KEEP.XML, FUZZYSUGGEST.TXT, BAD-SCHEMA-NOT-INDEXED-BUT-NORMS.XML, SCHEMA-REST.XML, SOLRCONFIG-SOLCOREPROPERTIES.XML, STOP-1.TXT, SOLRCONFIG-MASTER2.XML, SCHEMA-SPELLCHECKER.XML, SOLRCONFIG-RESPONSE-LOG-COMPONENT.XML, SOLRCONFIG-LAZYWRITER.XML, SCHEMA-LUCENEMATCHVERSION.XML, BAD-MP-SOLRCONFIG.XML, FRENCHARTICLES.TXT, SCHEMA15.XML, SOLRCONFIG-REQHANDLER.INCL, SCHEMASURROUND.XML, SCHEMA-COLLATEFILTER.XML, SOLRCONFIG-MASTER3.XML, HUNSPELL-TEST.DIC, SOLRCONFIG-XINCLUDE.XML, BAD-SCHEMA-CODEC-GLOBAL-VS-FT-MISMATCH.XML, SOLRCONFIG-SLAVE1.XML, SOLRCONFIG-DELPOLICY1.XML, SCHEMA-SIM.XML, SCHEMA-SNIPPET-FIELD.XML, SCHEMA-COLLATE.XML, STOP-SNOWBALL.TXT, BAD-SCHEMA-SIM-GLOBAL-VS-FT-MISMATCH.XML, PROTWORDS.TXT, SCHEMA-TRIE.XML, SOLRCONFIG_CODEC.XML, SCHEMA-SYNONYM-TOKENIZER.XML, BAD-SOLRCONFIG-INVALID-SCRIPTFILE.XML, JASUGGEST.TXT, SCHEMA-DOCVALUESFACETING.XML, SCHEMA-TFIDF.XML, SOLRCONFIG-SCRIPT-UPDATEPROCESSOR.XML, SCHEMA-LMJELINEKMERCER.XML, PHRASESUGGEST.TXT, BAD-SOLRCONFIG-MISSING-SCRIPTFILE.XML, SOLRCONFIG-BASIC-LUCENEVERSION31.XML, BAD-SCHEMA-UNIQUEKEY-USES-DEFAULT.XML, OLD_SYNONYMS.TXT, SOLRCONFIG-DELPOLICY2.XML, SOLRCONFIG-NATIVELOCK.XML, XSLT, BAD-SCHEMA-DUP-FIELD.XML, SOLRCONFIG-NOCACHE.XML, SCHEMA-BM25.XML, BAD-SCHEMA-SWEETSPOT-BOTH-TF.XML, ADDFIELDS.UPDATEPROCESSOR.JS, SOLRCONFIG-ALTDIRECTORY.XML, SOLRCONFIG-QUERYSENDER-NOQUERY.XML, COMPOUNDDICTIONARY.TXT, SOLRCONFIG-INDEXCONFIG.XML, SOLRCONFIG_PERF.XML, BAD-CURRENCY.XML, BAD-SCHEMA-CURRENCY-FT-BOGUS-DEFAULT-CODE.XML, BAD-SCHEMA-ANALYZER-CLASS-AND-NESTED.XML, SCHEMA-NOT-REQUIRED-UNIQUE-KEY.XML, KEEP-2.TXT, SCHEMA12.XML, BAD-SCHEMA-UNIQUEKEY-IS-COPYFIELD-DEST.XML, MAPPING-ISOLATIN1ACCENT.TXT, BAD_SOLRCONFIG.XML, BAD-SCHEMA-EXTERNAL-FILEFIELD.XML]
[junit4:junit4]   2> 10274 T113 oass.SolrIndexSearcher.<init> Opening Searcher@710afce3 main
[junit4:junit4]   2> 10275 T113 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 10276 T113 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 10277 T113 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 10280 T113 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 10299 T121 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@710afce3 main{StandardDirectoryReader(segments_4:11:nrt _1(4.3):C1 _2(4.3):C1 _3(4.3):C1)}
[junit4:junit4]   2> 10310 T113 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 10310 T113 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 10311 T113 oasu.DefaultSolrCoreState.newIndexWriter Closing old IndexWriter... core=collection1
[junit4:junit4]   2> 10328 T113 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/index3941139413tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@2d7f6d79)),segFN=segments_4,generation=4,filenames=[_2.si, _1.doc, _2.pos, _3.tim, _3.fnm, _3.pos, _3.fdt, _1.fnm, _2.doc, _2.tim, _3.nvd, _1.pos, _3.nvm, _1.tip, _1.tim, _1.nvm, _1.nvd, _3.doc, _2.fdt, _2.fdx, _2.fnm, _3.fdx, _1.fdx, _2.tip, _2.nvm, _1.fdt, _1.si, _2.nvd, _3.tip, _3.si, segments_4]
[junit4:junit4]   2> 10329 T113 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[_2.si, _1.doc, _2.pos, _3.tim, _3.fnm, _3.pos, _3.fdt, _1.fnm, _2.doc, _2.tim, _3.nvd, _1.pos, _3.nvm, _1.tip, _1.tim, _1.nvm, _1.nvd, _3.doc, _2.fdt, _2.fdx, _2.fnm, _3.fdx, _1.fdx, _2.tip, _2.nvm, _1.fdt, _1.si, _2.nvd, _3.tip, _3.si, segments_4]
[junit4:junit4]   2> 10330 T113 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 10341 T113 oass.SolrIndexSearcher.<init> Opening Searcher@54fabfeb main
[junit4:junit4]   2> 10342 T113 oasc.CoreContainer.registerCore replacing core: collection1
[junit4:junit4]   2> 10342 T113 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@1a71fa61
[junit4:junit4]   2> 10344 T121 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@54fabfeb main{StandardDirectoryReader(segments_4:11:nrt _1(4.3):C1 _2(4.3):C1 _3(4.3):C1)}
[junit4:junit4]   2> 10352 T113 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=3,autocommit maxTime=1200ms,autocommits=1,soft autocommit maxTime=500ms,soft autocommits=2,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=2,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 10353 T113 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4]   2> ASYNC  NEW_CORE C6 name=collection1 org.apache.solr.core.SolrCore@3a2634af
[junit4:junit4]   2> 10368 T113 C6 UPDATE [collection1] webapp=null path=null params={} {add=[5000]} 0 4
[junit4:junit4]   2> 10380 T113 C6 UPDATE [collection1] webapp=null path=null params={} {add=[5001]} 0 2
[junit4:junit4]   2> 10461 T113 C6 UPDATE [collection1] webapp=null path=null params={} {add=[5002]} 0 2
[junit4:junit4]   2> 10473 T113 C6 UPDATE [collection1] webapp=null path=null params={} {add=[5003]} 0 2
[junit4:junit4]   2> 10484 T113 C6 UPDATE [collection1] webapp=null path=null params={} {add=[5004]} 0 2
[junit4:junit4]   2> 10487 T113 oas.SolrTestCaseJ4.tearDown ###Ending testSoftAndHardCommitMaxTimeRapidAdds
[junit4:junit4]   2> 10490 T113 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> 10490 T113 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1085112373
[junit4:junit4]   2> 10491 T113 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@3a2634af
[junit4:junit4]   2> 10508 T113 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommit maxTime=1200ms,autocommits=0,soft autocommit maxTime=500ms,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=5,adds=5,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=5,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 10509 T113 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4]   2> 10510 T113 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 10510 T113 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2> 10576 T113 C6 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/index3941139413tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@2d7f6d79)),segFN=segments_4,generation=4,filenames=[_2.si, _1.doc, _2.pos, _3.tim, _3.fnm, _3.pos, _3.fdt, _1.fnm, _2.doc, _2.tim, _3.nvd, _1.pos, _3.nvm, _1.tip, _1.tim, _1.nvm, _1.nvd, _3.doc, _2.fdt, _2.fdx, _2.fnm, _3.fdx, _1.fdx, _2.tip, _2.nvm, _1.fdt, _1.si, _2.nvd, _3.tip, _3.si, segments_4]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/index3941139413tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@2d7f6d79)),segFN=segments_5,generation=5,filenames=[_2.si, _1.doc, _2.pos, _3.tim, _4.fnm, _3.fnm, _3.pos, _3.fdt, _1.fnm, _2.doc, _2.tim, _4.fdx, _4.doc, _3.nvd, _1.pos, _4.tip, _3.nvm, _1.tip, _1.tim, _1.nvm, _4.tim, _4.pos, _1.nvd, _3.doc, _2.fdt, _4.si, _4.fdt, _2.fdx, _2.fnm, _3.fdx, _1.fdx, _2.tip, _4.nvd, _2.nvm, _1.fdt, _1.si, _2.nvd, _3.tip, _3.si, segments_5, _4.nvm]
[junit4:junit4]   2> 10577 T113 C6 oasc.SolrDeletionPolicy.updateCommits newest commit = 5[_2.si, _1.doc, _2.pos, _3.tim, _4.fnm, _3.fnm, _3.pos, _3.fdt, _1.fnm, _2.doc, _2.tim, _4.fdx, _4.doc, _3.nvd, _1.pos, _4.tip, _3.nvm, _1.tip, _1.tim, _1.nvm, _4.tim, _4.pos, _1.nvd, _3.doc, _2.fdt, _4.si, _4.fdt, _2.fdx, _2.fnm, _3.fdx, _1.fdx, _2.tip, _4.nvd, _2.nvm, _1.fdt, _1.si, _2.nvd, _3.tip, _3.si, segments_5, _4.nvm]
[junit4:junit4]   2> 10581 T113 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4]   2> 10583 T113 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./solrtest-SoftAutoCommitTest-1363915571369
[junit4:junit4]   2> 10583 T113 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./solrtest-SoftAutoCommitTest-1363915571369
[junit4:junit4]   2> 10584 T113 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./solrtest-SoftAutoCommitTest-1363915571369/index
[junit4:junit4]   2> 10585 T113 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./solrtest-SoftAutoCommitTest-1363915571369/index
[junit4:junit4]   2> NOTE: test params are: codec=Asserting, sim=RandomSimilarityProvider(queryNorm=true,coord=yes): {}, locale=pt_BR, timezone=Antarctica/Syowa
[junit4:junit4]   2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_17 (64-bit)/cpus=16,threads=1,free=124845480,total=159383552
[junit4:junit4]   2> NOTE: All tests run in this JVM: [SpellCheckCollatorTest, SolrCoreTest, TestSort, TestLazyCores, TestBinaryField, SoftAutoCommitTest]
[junit4:junit4] Completed on J0 in 10.64s, 3 tests, 1 failure <<< FAILURES!

[...truncated 247 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.SyncSliceTest
[junit4:junit4]   2> 0 T881 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4]   2> 5 T881 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./solrtest-SyncSliceTest-1363915773517
[junit4:junit4]   2> 6 T881 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 6 T882 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 9 T882 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 9 T882 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4]   2> 9 T882 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4]   2> 10 T882 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 11 T882 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1363915773517/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4]   2> 107 T881 oasc.ZkTestServer.run start zk server on port:29270
[junit4:junit4]   2> 107 T881 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:29270 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@235013dc
[junit4:junit4]   2> 108 T881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 109 T887 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:29270. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 109 T887 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:29270, initiating session
[junit4:junit4]   2> 110 T883 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:29271
[junit4:junit4]   2> 110 T883 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:29271
[junit4:junit4]   2> 110 T885 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 114 T885 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8fb716530000 with negotiated timeout 10000 for client /140.211.11.196:29271
[junit4:junit4]   2> 114 T887 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:29270, sessionid = 0x13d8fb716530000, negotiated timeout = 10000
[junit4:junit4]   2> 115 T888 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@235013dc name:ZooKeeperConnection Watcher:127.0.0.1:29270 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 115 T881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 115 T881 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 118 T886 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d8fb716530000
[junit4:junit4]   2> 129 T888 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 130 T883 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:29271 which had sessionid 0x13d8fb716530000
[junit4:junit4]   2> 129 T881 oaz.ZooKeeper.close Session: 0x13d8fb716530000 closed
[junit4:junit4]   2> 130 T881 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:29270/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@198a7a13
[junit4:junit4]   2> 131 T881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 131 T889 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:29270. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 132 T889 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:29270, initiating session
[junit4:junit4]   2> 132 T883 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:29272
[junit4:junit4]   2> 132 T883 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:29272
[junit4:junit4]   2> 134 T885 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8fb716530001 with negotiated timeout 10000 for client /140.211.11.196:29272
[junit4:junit4]   2> 134 T889 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:29270, sessionid = 0x13d8fb716530001, negotiated timeout = 10000
[junit4:junit4]   2> 134 T890 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@198a7a13 name:ZooKeeperConnection Watcher:127.0.0.1:29270/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 134 T881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 135 T881 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 145 T881 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 149 T881 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 151 T881 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 160 T881 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 161 T881 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 174 T881 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 175 T881 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 280 T881 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 281 T881 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 284 T881 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 285 T881 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 294 T881 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 295 T881 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 298 T881 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 299 T881 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 302 T881 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 303 T881 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 306 T881 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 307 T881 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 310 T881 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 311 T881 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 314 T886 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d8fb716530001
[junit4:junit4]   2> 321 T890 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 321 T883 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:29272 which had sessionid 0x13d8fb716530001
[junit4:junit4]   2> 321 T881 oaz.ZooKeeper.close Session: 0x13d8fb716530001 closed
[junit4:junit4]   2> 469 T881 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 475 T881 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:29273
[junit4:junit4]   2> 476 T881 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 476 T881 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 477 T881 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363915773833
[junit4:junit4]   2> 477 T881 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363915773833/solr.xml
[junit4:junit4]   2> 477 T881 oasc.CoreContainer.<init> New CoreContainer 1378369635
[junit4:junit4]   2> 478 T881 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363915773833/'
[junit4:junit4]   2> 478 T881 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363915773833/'
[junit4:junit4]   2> 526 T881 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 527 T881 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 527 T881 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 527 T881 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 528 T881 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 528 T881 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 528 T881 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 529 T881 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 529 T881 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 529 T881 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 547 T881 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 562 T881 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:29270/solr
[junit4:junit4]   2> 562 T881 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 563 T881 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:29270 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@50782f92
[junit4:junit4]   2> 564 T881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 564 T900 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:29270. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 565 T900 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:29270, initiating session
[junit4:junit4]   2> 565 T883 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:29274
[junit4:junit4]   2> 566 T883 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:29274
[junit4:junit4]   2> 568 T885 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8fb716530002 with negotiated timeout 20000 for client /140.211.11.196:29274
[junit4:junit4]   2> 568 T900 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:29270, sessionid = 0x13d8fb716530002, negotiated timeout = 20000
[junit4:junit4]   2> 568 T901 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@50782f92 name:ZooKeeperConnection Watcher:127.0.0.1:29270 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 569 T881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 570 T886 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d8fb716530002
[junit4:junit4]   2> 616 T901 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 617 T883 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:29274 which had sessionid 0x13d8fb716530002
[junit4:junit4]   2> 616 T881 oaz.ZooKeeper.close Session: 0x13d8fb716530002 closed
[junit4:junit4]   2> 617 T881 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 626 T881 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:29270/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@4b03257c
[junit4:junit4]   2> 627 T881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 628 T902 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:29270. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 628 T902 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:29270, initiating session
[junit4:junit4]   2> 628 T883 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:29275
[junit4:junit4]   2> 628 T883 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:29275
[junit4:junit4]   2> 631 T885 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8fb716530003 with negotiated timeout 20000 for client /140.211.11.196:29275
[junit4:junit4]   2> 631 T902 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:29270, sessionid = 0x13d8fb716530003, negotiated timeout = 20000
[junit4:junit4]   2> 631 T903 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4b03257c name:ZooKeeperConnection Watcher:127.0.0.1:29270/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 631 T881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 633 T881 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4]   2> 636 T886 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8fb716530003 type:create cxid:0x7 zxid:0x1b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 638 T881 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4]   2> 641 T881 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 644 T881 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:29273_
[junit4:junit4]   2> 644 T886 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8fb716530003 type:delete cxid:0x12 zxid:0x1e txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:29273_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:29273_
[junit4:junit4]   2> 653 T881 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:29273_
[junit4:junit4]   2> 657 T881 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 675 T886 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8fb716530003 type:delete cxid:0x20 zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 688 T881 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 691 T881 oasc.Overseer.start Overseer (id=89385584133603331-127.0.0.1:29273_-n_0000000000) starting
[junit4:junit4]   2> 691 T886 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8fb716530003 type:create cxid:0x25 zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 694 T886 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8fb716530003 type:create cxid:0x26 zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 696 T886 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8fb716530003 type:create cxid:0x28 zxid:0x27 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 697 T881 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4]   2> 716 T886 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8fb716530003 type:create cxid:0x2e zxid:0x29 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 720 T905 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4]   2> 721 T881 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 727 T881 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4]   2> 729 T881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 731 T904 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 735 T906 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363915773833/collection1
[junit4:junit4]   2> 735 T906 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4]   2> 736 T906 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 736 T906 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4]   2> 738 T906 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363915773833/collection1/'
[junit4:junit4]   2> 739 T906 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-controljetty-1363915773833/collection1/lib/README' to classloader
[junit4:junit4]   2> 739 T906 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-controljetty-1363915773833/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 787 T906 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4]   2> 848 T906 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 949 T906 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 957 T906 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 1590 T906 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 1603 T906 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 1607 T906 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 1625 T906 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1630 T906 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1635 T906 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1636 T906 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 1637 T906 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 1638 T906 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1639 T906 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 1639 T906 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 1640 T906 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 1676 T906 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363915773833/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363915773517/control/data/
[junit4:junit4]   2> 1676 T906 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@bb933cb
[junit4:junit4]   2> 1677 T906 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 1678 T906 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363915773517/control/data
[junit4:junit4]   2> 1678 T906 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363915773517/control/data/index/
[junit4:junit4]   2> 1679 T906 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363915773517/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 1680 T906 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363915773517/control/data/index
[junit4:junit4]   2> 1687 T906 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363915773517/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@2b298bd5; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 1687 T906 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 1690 T906 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 1690 T906 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 1691 T906 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 1692 T906 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 1692 T906 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 1692 T906 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 1693 T906 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 1693 T906 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 1693 T906 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 1707 T906 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 1715 T906 oass.SolrIndexSearcher.<init> Opening Searcher@4d28aa6a main
[junit4:junit4]   2> 1716 T906 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 1716 T906 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 1720 T907 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4d28aa6a main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 1722 T906 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 1722 T906 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 2236 T904 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2237 T904 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:29273_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:29273"}
[junit4:junit4]   2> 2237 T904 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4]   2> 2238 T904 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 2290 T903 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 2725 T906 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 2725 T906 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:29273 collection:control_collection shard:shard1
[junit4:junit4]   2> 2726 T906 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4]   2> 2764 T886 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8fb716530003 type:delete cxid:0x82 zxid:0x35 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4]   2> 2765 T906 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 2765 T886 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8fb716530003 type:create cxid:0x83 zxid:0x36 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2768 T906 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 2768 T906 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 2769 T906 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:29273/collection1/
[junit4:junit4]   2> 2769 T906 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 2770 T906 oasc.SyncStrategy.syncToMe http://127.0.0.1:29273/collection1/ has no replicas
[junit4:junit4]   2> 2770 T906 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:29273/collection1/
[junit4:junit4]   2> 2770 T906 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4]   2> 2775 T886 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8fb716530003 type:create cxid:0x8e zxid:0x3a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3795 T904 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3839 T903 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 3899 T906 oasc.ZkController.register We are http://127.0.0.1:29273/collection1/ and leader is http://127.0.0.1:29273/collection1/
[junit4:junit4]   2> 3899 T906 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:29273
[junit4:junit4]   2> 3899 T906 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 3900 T906 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 3900 T906 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 3902 T906 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3903 T881 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1
[junit4:junit4]   2> 3904 T881 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 3905 T881 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 3921 T881 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 3927 T881 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:29270/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@771203c2
[junit4:junit4]   2> 3928 T881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3929 T909 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:29270. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 3929 T909 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:29270, initiating session
[junit4:junit4]   2> 3930 T883 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:29280
[junit4:junit4]   2> 3930 T883 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:29280
[junit4:junit4]   2> 3931 T885 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8fb716530004 with negotiated timeout 10000 for client /140.211.11.196:29280
[junit4:junit4]   2> 3931 T909 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:29270, sessionid = 0x13d8fb716530004, negotiated timeout = 10000
[junit4:junit4]   2> 3932 T910 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@771203c2 name:ZooKeeperConnection Watcher:127.0.0.1:29270/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3932 T881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3933 T881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3939 T881 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 4149 T881 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 4153 T881 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:29281
[junit4:junit4]   2> 4153 T881 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 4154 T881 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 4154 T881 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363915777452
[junit4:junit4]   2> 4155 T881 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363915777452/solr.xml
[junit4:junit4]   2> 4155 T881 oasc.CoreContainer.<init> New CoreContainer 917966469
[junit4:junit4]   2> 4156 T881 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363915777452/'
[junit4:junit4]   2> 4157 T881 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363915777452/'
[junit4:junit4]   2> 4220 T881 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 4221 T881 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 4221 T881 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 4222 T881 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 4222 T881 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 4223 T881 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 4223 T881 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 4224 T881 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 4224 T881 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 4224 T881 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 4246 T881 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 4266 T881 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:29270/solr
[junit4:junit4]   2> 4266 T881 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 4267 T881 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:29270 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@58d62cd8
[junit4:junit4]   2> 4268 T881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4268 T920 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:29270. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 4269 T920 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:29270, initiating session
[junit4:junit4]   2> 4270 T883 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:29282
[junit4:junit4]   2> 4270 T883 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:29282
[junit4:junit4]   2> 4273 T885 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8fb716530005 with negotiated timeout 20000 for client /140.211.11.196:29282
[junit4:junit4]   2> 4273 T920 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:29270, sessionid = 0x13d8fb716530005, negotiated timeout = 20000
[junit4:junit4]   2> 4273 T921 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@58d62cd8 name:ZooKeeperConnection Watcher:127.0.0.1:29270 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4273 T881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4275 T886 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d8fb716530005
[junit4:junit4]   2> 4289 T921 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 4289 T881 oaz.ZooKeeper.close Session: 0x13d8fb716530005 closed
[junit4:junit4]   2> 4289 T883 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:29282 which had sessionid 0x13d8fb716530005
[junit4:junit4]   2> 4289 T881 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 4301 T881 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:29270/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@48642c32
[junit4:junit4]   2> 4320 T922 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:29270. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 4319 T881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4320 T922 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:29270, initiating session
[junit4:junit4]   2> 4320 T883 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:29283
[junit4:junit4]   2> 4321 T883 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:29283
[junit4:junit4]   2> 4323 T885 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8fb716530006 with negotiated timeout 20000 for client /140.211.11.196:29283
[junit4:junit4]   2> 4323 T922 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:29270, sessionid = 0x13d8fb716530006, negotiated timeout = 20000
[junit4:junit4]   2> 4323 T923 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@48642c32 name:ZooKeeperConnection Watcher:127.0.0.1:29270/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4324 T881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4325 T886 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8fb716530006 type:create cxid:0x1 zxid:0x48 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4327 T886 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8fb716530006 type:create cxid:0x3 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4335 T881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 5338 T881 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:29281_
[junit4:junit4]   2> 5340 T886 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8fb716530006 type:delete cxid:0xd zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:29281_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:29281_
[junit4:junit4]   2> 5341 T881 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:29281_
[junit4:junit4]   2> 5344 T903 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 5345 T923 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 5345 T910 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 5346 T903 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 5362 T924 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363915777452/collection1
[junit4:junit4]   2> 5362 T904 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5362 T924 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 5363 T904 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"127.0.0.1:29273__collection1",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:29273_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:29273"}
[junit4:junit4]   2> 5363 T924 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 5363 T924 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 5365 T924 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363915777452/collection1/'
[junit4:junit4]   2> 5366 T924 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty1-1363915777452/collection1/lib/README' to classloader
[junit4:junit4]   2> 5367 T924 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty1-1363915777452/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 5400 T903 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5400 T923 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5400 T910 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5418 T924 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4]   2> 5477 T924 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 5578 T924 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 5585 T924 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 6222 T924 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 6234 T924 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 6238 T924 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 6254 T924 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 6260 T924 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 6264 T924 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 6265 T924 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 6267 T924 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 6267 T924 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 6268 T924 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 6268 T924 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 6269 T924 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 6269 T924 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363915777452/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363915773517/jetty1/
[junit4:junit4]   2> 6269 T924 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@bb933cb
[junit4:junit4]   2> 6270 T924 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 6271 T924 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363915773517/jetty1
[junit4:junit4]   2> 6271 T924 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363915773517/jetty1/index/
[junit4:junit4]   2> 6272 T924 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363915773517/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 6273 T924 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363915773517/jetty1/index
[junit4:junit4]   2> 6279 T924 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363915773517/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6dc58d43; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 6279 T924 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 6282 T924 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 6282 T924 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 6283 T924 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 6284 T924 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 6284 T924 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 6285 T924 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 6285 T924 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 6286 T924 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 6286 T924 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 6298 T924 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 6306 T924 oass.SolrIndexSearcher.<init> Opening Searcher@2b2c0334 main
[junit4:junit4]   2> 6307 T924 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 6307 T924 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 6311 T925 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2b2c0334 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 6314 T924 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 6314 T924 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 6905 T904 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6906 T904 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:29281_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:29281"}
[junit4:junit4]   2> 6906 T904 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 1
[junit4:junit4]   2> 6906 T904 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 6911 T903 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 6911 T923 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 6911 T910 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 7317 T924 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 7317 T924 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:29281 collection:collection1 shard:shard1
[junit4:junit4]   2> 7318 T924 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 7397 T886 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8fb716530006 type:delete cxid:0x4a zxid:0x5a txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 7422 T924 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 7423 T886 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8fb716530006 type:create cxid:0x4b zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 7440 T924 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 7440 T924 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 7441 T924 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:29281/collection1/
[junit4:junit4]   2> 7441 T924 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 7441 T924 oasc.SyncStrategy.syncToMe http://127.0.0.1:29281/collection1/ has no replicas
[junit4:junit4]   2> 7441 T924 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:29281/collection1/
[junit4:junit4]   2> 7441 T924 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 7445 T886 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8fb716530006 type:create cxid:0x56 zxid:0x5f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 8428 T904 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8471 T903 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 8471 T923 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 8471 T910 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 8520 T924 oasc.ZkController.register We are http://127.0.0.1:29281/collection1/ and leader is http://127.0.0.1:29281/collection1/
[junit4:junit4]   2> 8520 T924 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:29281
[junit4:junit4]   2> 8520 T924 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 8520 T924 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 8520 T924 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 8523 T924 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8523 T881 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1
[junit4:junit4]   2> 8524 T881 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 8524 T881 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 8665 T881 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 8668 T881 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:29291
[junit4:junit4]   2> 8668 T881 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 8669 T881 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 8669 T881 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363915782047
[junit4:junit4]   2> 8669 T881 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363915782047/solr.xml
[junit4:junit4]   2> 8669 T881 oasc.CoreContainer.<init> New CoreContainer 22354617
[junit4:junit4]   2> 8670 T881 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363915782047/'
[junit4:junit4]   2> 8670 T881 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363915782047/'
[junit4:junit4]   2> 8713 T881 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 8714 T881 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 8714 T881 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 8714 T881 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 8715 T881 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 8715 T881 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 8715 T881 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 8716 T881 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 8716 T881 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 8716 T881 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 8732 T881 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 8745 T881 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:29270/solr
[junit4:junit4]   2> 8746 T881 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 8746 T881 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:29270 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@3dc158dc
[junit4:junit4]   2> 8747 T881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 8747 T936 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:29270. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 8748 T936 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:29270, initiating session
[junit4:junit4]   2> 8748 T883 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:29292
[junit4:junit4]   2> 8749 T883 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:29292
[junit4:junit4]   2> 8751 T885 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8fb716530007 with negotiated timeout 20000 for client /140.211.11.196:29292
[junit4:junit4]   2> 8751 T936 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:29270, sessionid = 0x13d8fb716530007, negotiated timeout = 20000
[junit4:junit4]   2> 8751 T937 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3dc158dc name:ZooKeeperConnection Watcher:127.0.0.1:29270 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 8751 T881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 8752 T886 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d8fb716530007
[junit4:junit4]   2> 8764 T937 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 8764 T883 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:29292 which had sessionid 0x13d8fb716530007
[junit4:junit4]   2> 8764 T881 oaz.ZooKeeper.close Session: 0x13d8fb716530007 closed
[junit4:junit4]   2> 8764 T881 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 8773 T881 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:29270/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@4e264d7e
[junit4:junit4]   2> 8774 T881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 8774 T938 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:29270. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 8775 T938 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:29270, initiating session
[junit4:junit4]   2> 8775 T883 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:29293
[junit4:junit4]   2> 8775 T883 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:29293
[junit4:junit4]   2> 8776 T885 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8fb716530008 with negotiated timeout 20000 for client /140.211.11.196:29293
[junit4:junit4]   2> 8776 T938 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:29270, sessionid = 0x13d8fb716530008, negotiated timeout = 20000
[junit4:junit4]   2> 8777 T939 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4e264d7e name:ZooKeeperConnection Watcher:127.0.0.1:29270/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 8777 T881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 8777 T886 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8fb716530008 type:create cxid:0x1 zxid:0x6c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 8783 T886 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8fb716530008 type:create cxid:0x3 zxid:0x6d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 8785 T881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 9788 T881 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:29291_
[junit4:junit4]   2> 9789 T886 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8fb716530008 type:delete cxid:0xd zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:29291_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:29291_
[junit4:junit4]   2> 9790 T881 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:29291_
[junit4:junit4]   2> 9792 T910 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 9792 T903 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 9792 T923 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 9794 T939 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 9795 T910 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 9795 T923 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 9795 T903 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 9812 T940 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363915782047/collection1
[junit4:junit4]   2> 9813 T940 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 9813 T940 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 9813 T940 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 9815 T940 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363915782047/collection1/'
[junit4:junit4]   2> 9815 T940 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty2-1363915782047/collection1/lib/README' to classloader
[junit4:junit4]   2> 9816 T940 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty2-1363915782047/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 9851 T940 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4]   2> 9892 T940 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 9988 T904 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9989 T904 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"127.0.0.1:29281__collection1",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:29281_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:29281"}
[junit4:junit4]   2> 9993 T940 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 9998 T940 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 10008 T903 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 10008 T910 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 10008 T923 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 10008 T939 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 10437 T940 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 10446 T940 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 10449 T940 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 10461 T940 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 10465 T940 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 10469 T940 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 10470 T940 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 10471 T940 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 10471 T940 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 10472 T940 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 10472 T940 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 10472 T940 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 10472 T940 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363915782047/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363915773517/jetty2/
[junit4:junit4]   2> 10473 T940 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@bb933cb
[junit4:junit4]   2> 10473 T940 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 10474 T940 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363915773517/jetty2
[junit4:junit4]   2> 10474 T940 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363915773517/jetty2/index/
[junit4:junit4]   2> 10474 T940 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363915773517/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 10475 T940 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363915773517/jetty2/index
[junit4:junit4]   2> 10480 T940 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363915773517/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@13d6674c; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 10480 T940 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 10482 T940 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 10482 T940 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 10483 T940 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 10483 T940 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 10484 T940 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 10484 T940 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 10484 T940 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 10485 T940 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 10485 T940 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 10493 T940 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 10499 T940 oass.SolrIndexSearcher.<init> Opening Searcher@183ea8d main
[junit4:junit4]   2> 10500 T940 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 10500 T940 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 10503 T941 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@183ea8d main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 10505 T940 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 10505 T940 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 11513 T904 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 11514 T904 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:29291_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:29291"}
[junit4:junit4]   2> 11514 T904 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 11514 T904 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 11519 T903 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11519 T910 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11519 T939 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11519 T923 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 12509 T940 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 12509 T940 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:29291 collection:collection1 shard:shard1
[junit4:junit4]   2> 12517 T940 oasc.ZkController.register We are http://127.0.0.1:29291/collection1/ and leader is http://127.0.0.1:29281/collection1/
[junit4:junit4]   2> 12518 T940 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:29291
[junit4:junit4]   2> 12518 T940 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 12518 T940 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C46 name=collection1 org.apache.solr.core.SolrCore@4c0e4a2b url=http://127.0.0.1:29291/collection1 node=127.0.0.1:29291_ C46_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:29291_, base_url=http://127.0.0.1:29291}
[junit4:junit4]   2> 12526 T942 C46 P29291 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 12526 T940 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 12527 T942 C46 P29291 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 12528 T942 C46 P29291 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 12528 T942 C46 P29291 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 12528 T881 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1
[junit4:junit4]   2> 12529 T881 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 12530 T881 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 12531 T942 C46 P29291 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 12772 T881 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 12776 T881 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:29295
[junit4:junit4]   2> 12777 T881 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 12777 T881 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 12778 T881 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363915786065
[junit4:junit4]   2> 12778 T881 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363915786065/solr.xml
[junit4:junit4]   2> 12779 T881 oasc.CoreContainer.<init> New CoreContainer 1518344743
[junit4:junit4]   2> 12780 T881 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363915786065/'
[junit4:junit4]   2> 12780 T881 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363915786065/'
[junit4:junit4]   2> 12865 T881 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 12866 T881 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 12867 T881 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 12867 T881 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 12868 T881 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 12869 T881 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 12870 T881 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 12870 T881 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 12871 T881 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 12872 T881 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 12907 T881 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 12935 T881 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:29270/solr
[junit4:junit4]   2> 12936 T881 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 12937 T881 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:29270 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@3b902263
[junit4:junit4]   2> 12938 T881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 12939 T953 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:29270. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 12940 T953 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:29270, initiating session
[junit4:junit4]   2> 12940 T883 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:29297
[junit4:junit4]   2> 12940 T883 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:29297
[junit4:junit4]   2> 12942 T885 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8fb716530009 with negotiated timeout 20000 for client /140.211.11.196:29297
[junit4:junit4]   2> 12942 T953 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:29270, sessionid = 0x13d8fb716530009, negotiated timeout = 20000
[junit4:junit4]   2> 12943 T954 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3b902263 name:ZooKeeperConnection Watcher:127.0.0.1:29270 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 12943 T881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 12945 T886 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d8fb716530009
[junit4:junit4]   2> 12953 T954 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 12953 T883 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:29297 which had sessionid 0x13d8fb716530009
[junit4:junit4]   2> 12953 T881 oaz.ZooKeeper.close Session: 0x13d8fb716530009 closed
[junit4:junit4]   2> 12954 T881 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 12971 T881 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:29270/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@7058e3b9
[junit4:junit4]   2> 12973 T881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 12973 T955 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:29270. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 12974 T955 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:29270, initiating session
[junit4:junit4]   2> 12974 T883 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:29298
[junit4:junit4]   2> 12975 T883 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:29298
[junit4:junit4]   2> 12981 T885 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8fb71653000a with negotiated timeout 20000 for client /140.211.11.196:29298
[junit4:junit4]   2> 12981 T955 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:29270, sessionid = 0x13d8fb71653000a, negotiated timeout = 20000
[junit4:junit4]   2> 12981 T956 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7058e3b9 name:ZooKeeperConnection Watcher:127.0.0.1:29270/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 12981 T881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 12983 T886 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8fb71653000a type:create cxid:0x1 zxid:0x7f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 12985 T886 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8fb71653000a type:create cxid:0x3 zxid:0x80 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 12994 T881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 13039 T904 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 13040 T904 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"127.0.0.1:29291__collection1",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:29291_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:29291"}
[junit4:junit4]   2> 13053 T903 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 13053 T923 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 13053 T910 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 13053 T956 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 13053 T939 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 13571 T913 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {coreNodeName=127.0.0.1:29291__collection1&state=recovering&nodeName=127.0.0.1:29291_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1007 
[junit4:junit4]   2> 13999 T881 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:29295_
[junit4:junit4]   2> 14000 T886 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8fb71653000a type:delete cxid:0xf zxid:0x85 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:29295_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:29295_
[junit4:junit4]   2> 14030 T881 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:29295_
[junit4:junit4]   2> 14033 T903 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 14033 T910 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 14033 T923 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 14034 T956 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 14034 T939 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 14034 T956 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14035 T939 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14036 T903 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 14036 T923 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 14036 T910 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 14053 T957 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363915786065/collection1
[junit4:junit4]   2> 14053 T957 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 14054 T957 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 14054 T957 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 14056 T957 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363915786065/collection1/'
[junit4:junit4]   2> 14057 T957 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty3-1363915786065/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 14058 T957 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty3-1363915786065/collection1/lib/README' to classloader
[junit4:junit4]   2> 14108 T957 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4]   2> 14198 T957 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 14299 T957 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 14311 T957 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 15116 T957 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 15132 T957 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 15136 T957 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 15153 T957 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 15158 T957 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 15162 T957 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 15163 T957 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 15164 T957 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 15164 T957 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 15165 T957 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 15166 T957 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 15166 T957 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 15166 T957 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363915786065/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363915773517/jetty3/
[junit4:junit4]   2> 15167 T957 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@bb933cb
[junit4:junit4]   2> 15167 T957 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 15168 T957 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363915773517/jetty3
[junit4:junit4]   2> 15169 T957 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363915773517/jetty3/index/
[junit4:junit4]   2> 15169 T957 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363915773517/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 15170 T957 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363915773517/jetty3/index
[junit4:junit4]   2> 15175 T957 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363915773517/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@5e173225; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 15176 T957 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 15179 T957 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 15179 T957 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 15180 T957 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 15180 T957 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 15181 T957 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 15181 T957 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 15181 T957 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 15182 T957 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 15182 T957 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 15194 T957 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 15202 T957 oass.SolrIndexSearcher.<init> Opening Searcher@323f9af6 main
[junit4:junit4]   2> 15203 T957 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 15203 T957 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 15207 T958 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@323f9af6 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 15209 T957 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 15210 T957 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2>  C46_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:29291_, base_url=http://127.0.0.1:29291}
[junit4:junit4]   2> 15573 T942 C46 P29291 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:29281/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 15573 T942 C46 P29291 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:29291 START replicas=[http://127.0.0.1:29281/collection1/] nUpdates=100
[junit4:junit4]   2> 15574 T942 C46 P29291 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 15574 T942 C46 P29291 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 15575 T942 C46 P29291 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 15575 T942 C46 P29291 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 15575 T942 C46 P29291 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 15575 T942 C46 P29291 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:29281/collection1/. core=collection1
[junit4:junit4]   2> 15575 T942 C46 P29291 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C47 name=collection1 org.apache.solr.core.SolrCore@762969ac url=http://127.0.0.1:29281/collection1 node=127.0.0.1:29281_ C47_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:29281_, base_url=http://127.0.0.1:29281, leader=true}
[junit4:junit4]   2> 15583 T914 C47 P29281 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0 
[junit4:junit4]   2> 15611 T915 C47 P29281 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 15616 T915 C47 P29281 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363915773517/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6dc58d43; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 15617 T915 C47 P29281 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 15621 T915 C47 P29281 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363915773517/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6dc58d43; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363915773517/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6dc58d43; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 15622 T915 C47 P29281 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 15623 T915 C47 P29281 oass.SolrIndexSearcher.<init> Opening Searcher@14d1d347 realtime
[junit4:junit4]   2> 15624 T915 C47 P29281 oasu.DirectUpdateHandler2.commit

[...truncated too long message...]

2> 141789 T883 oazs.NIOServerCnxnFactory.run NIOServerCnxn factory exited run method
[junit4:junit4]   2> 141789 T956 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 141790 T881 oazs.ZooKeeperServer.shutdown shutting down
[junit4:junit4]   2> 141791 T881 oazs.SessionTrackerImpl.shutdown Shutting down
[junit4:junit4]   2> 141791 T881 oazs.PrepRequestProcessor.shutdown Shutting down
[junit4:junit4]   2> 141792 T881 oazs.SyncRequestProcessor.shutdown Shutting down
[junit4:junit4]   2> 141792 T881 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=SyncSliceTest -Dtests.method=testDistribSearch -Dtests.seed=9A03EFD7AD17965C -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ar_IQ -Dtests.timezone=Africa/Ouagadougou -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] FAILURE  142s J1 | SyncSliceTest.testDistribSearch <<<
[junit4:junit4]    > Throwable #1: java.lang.AssertionError: Test Setup Failure: shard1 should have just been set up to be inconsistent - but it's still consistent. Leader:http://127.0.0.1:29291/collection1 Dead Guy:http://127.0.0.1:29281/collection1skip list:[CloudJettyRunner [url=http://127.0.0.1:29310/collection1], CloudJettyRunner [url=http://127.0.0.1:29310/collection1]]
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([9A03EFD7AD17965C:1BE561CFDA48F660]:0)
[junit4:junit4]    > 	at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4]    > 	at org.junit.Assert.assertTrue(Assert.java:43)
[junit4:junit4]    > 	at org.junit.Assert.assertNotNull(Assert.java:526)
[junit4:junit4]    > 	at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:212)
[junit4:junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:601)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 141814 T881 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> NOTE: test params are: codec=SimpleText, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=ar_IQ, timezone=Africa/Ouagadougou
[junit4:junit4]   2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_17 (64-bit)/cpus=16,threads=5,free=65603768,total=439353344
[junit4:junit4]   2> NOTE: All tests run in this JVM: [JSONWriterTest, SchemaVersionSpecificBehaviorTest, TestDocSet, UUIDFieldTest, TestBadConfig, TestTrie, StatsComponentTest, TestSolrJ, TestArbitraryIndexDir, SimpleFacetsTest, TestSolrCoreProperties, SignatureUpdateProcessorFactoryTest, SolrIndexSplitterTest, FieldAnalysisRequestHandlerTest, AlternateDirectoryTest, TestLMDirichletSimilarityFactory, TestJmxMonitoredMap, TestOmitPositions, TestFastWriter, BasicFunctionalityTest, SpellCheckComponentTest, OverseerCollectionProcessorTest, TestFastOutputStream, AnalysisAfterCoreReloadTest, BadIndexSchemaTest, TestSweetSpotSimilarityFactory, SortByFunctionTest, HighlighterConfigTest, TestFoldingMultitermQuery, IndexReaderFactoryTest, TestIndexSearcher, TestShardHandlerFactory, CoreContainerCoreInitFailuresTest, SampleTest, TestStressVersions, TestPerFieldSimilarity, DefaultValueUpdateProcessorTest, TestAtomicUpdateErrorCases, SuggesterWFSTTest, DocumentBuilderTest, TestPostingsSolrHighlighter, PeerSyncTest, StatelessScriptUpdateProcessorFactoryTest, TestBinaryResponseWriter, TestPHPSerializedResponseWriter, ClusterStateUpdateTest, TestSolrQueryParser, PrimUtilsTest, TestSuggestSpellingConverter, TestUtils, DOMUtilTest, IndexSchemaRuntimeFieldTest, TestDynamicFieldCollectionResource, AutoCommitTest, TestStressReorder, TestSolrIndexConfig, TestCollationKeyRangeQueries, ZkControllerTest, TestGroupingSearch, QueryParsingTest, LeaderElectionTest, DistributedQueryElevationComponentTest, SolrRequestParserTest, SliceStateUpdateTest, TestFieldResource, TermVectorComponentTest, SyncSliceTest]
[junit4:junit4] Completed on J1 in 141.84s, 1 test, 1 failure <<< FAILURES!

[...truncated 531 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/build.xml:381: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/build.xml:361: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build.xml:183: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/common-build.xml:449: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/common-build.xml:1213: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/common-build.xml:877: There were test failures: 273 suites, 1148 tests, 2 failures, 27 ignored (8 assumptions)

Total time: 50 minutes 56 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure