You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2013/02/11 19:26:43 UTC
[JENKINS] Lucene-Solr-Tests-trunk-java7 - Build # 3726 - Still
Failing
Build: https://builds.apache.org/job/Lucene-Solr-Tests-trunk-java7/3726/
All tests passed
Build Log:
[...truncated 9421 lines...]
[junit4:junit4] ERROR: JVM J0 ended with an exception, command line: /usr/local/openjdk7/jre/bin/java -XX:+UseG1GC -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/heapdumps -Dtests.prefix=tests -Dtests.seed=83A748D08278AA73 -Xmx512M -Dtests.iters= -Dtests.verbose=false -Dtests.infostream=false -Dtests.codec=random -Dtests.postingsformat=random -Dtests.docvaluesformat=random -Dtests.locale=random -Dtests.timezone=random -Dtests.directory=random -Dtests.linedocsfile=europarl.lines.txt.gz -Dtests.luceneMatchVersion=5.0 -Dtests.cleanthreads=perClass -Djava.util.logging.config.file=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/testlogging.properties -Dtests.nightly=false -Dtests.weekly=false -Dtests.slow=true -Dtests.asserts.gracious=false -Dtests.multiplier=3 -DtempDir=. -Djava.io.tmpdir=. -Djunit4.tempDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/temp -Dclover.db.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/clover/db -Djava.security.manager=org.apache.lucene.util.TestSecurityManager -Djava.security.policy=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/tools/junit4/tests.policy -Dlucene.version=5.0-SNAPSHOT -Djetty.testMode=1 -Djetty.insecurerandom=1 -Dsolr.directoryFactory=org.apache.solr.core.MockDirectoryFactory -Djava.awt.headless=true -Dtests.jettyConnector=Socket -Dfile.encoding=US-ASCII -classpath /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/classes/test:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-test-framework/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/test-framework/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/codecs/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-solrj/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/analysis/common/lucene-analyzers-common-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/highlighter/lucene-highlighter-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/memory/lucene-memory-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/misc/lucene-misc-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/spatial/lucene-spatial-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/suggest/lucene-suggest-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/grouping/lucene-grouping-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/queries/lucene-queries-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/queryparser/lucene-queryparser-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/cglib-nodep-2.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/commons-cli-1.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/commons-codec-1.7.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/commons-fileupload-1.2.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/commons-lang-2.6.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/easymock-3.0.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/guava-13.0.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/javax.servlet-api-3.0.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/objenesis-1.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/spatial4j-0.3.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/commons-io-2.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/httpclient-4.1.3.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/httpcore-4.1.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/httpmime-4.1.3.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/jcl-over-slf4j-1.6.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/slf4j-api-1.6.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/slf4j-jdk14-1.6.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/wstx-asl-3.2.7.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/zookeeper-3.4.5.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-continuation-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-deploy-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-http-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-io-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-jmx-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-security-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-server-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-servlet-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-util-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-webapp-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-xml-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/servlet-api-3.0.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/example-DIH/solr/db/lib/hsqldb-1.8.0.10.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/core/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/test-framework/lib/junit-4.10.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/test-framework/lib/randomizedtesting-runner-2.0.8.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-launcher.jar:/home/hudson/.ant/lib/ivy-2.2.0.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-logging.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-regexp.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-oro.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-swing.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jdepend.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-xalan2.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bsf.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit4.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-net.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-antlr.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jmf.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-netrexx.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-log4j.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-resolver.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jsch.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-testutil.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bcel.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jai.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-javamail.jar:/usr/local/openjdk7/lib/tools.jar:/home/hudson/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.0.8.jar -ea:org.apache.lucene... -ea:org.apache.solr... com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe -eventsfile /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/temp/junit4-J0-20130211_175438_581.events @/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/temp/junit4-J0-20130211_175438_581.suites
[junit4:junit4] ERROR: JVM J0 ended with an exception: Forked process returned with error code: 134. Very likely a JVM crash. Process output piped in logs above.
[junit4:junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4.executeSlave(JUnit4.java:1253)
[junit4:junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4.access$000(JUnit4.java:66)
[junit4:junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:821)
[junit4:junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:818)
[junit4:junit4] at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
[junit4:junit4] at java.util.concurrent.FutureTask.run(FutureTask.java:166)
[junit4:junit4] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
[junit4:junit4] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
[junit4:junit4] at java.lang.Thread.run(Thread.java:722)
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:381: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:361: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build.xml:183: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/common-build.xml:447: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/common-build.xml:1202: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/common-build.xml:865: At least one slave process threw an exception, first: Forked process returned with error code: 134. Very likely a JVM crash. Process output piped in logs above.
Total time: 56 minutes 30 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-Tests-trunk-java7 - Build # 3728 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-trunk-java7/3728/
1 tests failed.
REGRESSION: org.apache.solr.cloud.BasicDistributedZkTest.testDistribSearch
Error Message:
No registered leader was found, collection:unloadcollection slice:shard1
Stack Trace:
org.apache.solr.common.SolrException: No registered leader was found, collection:unloadcollection slice:shard1
at __randomizedtesting.SeedInfo.seed([703551648690CA12:F1D3DF7CF1CFAA2E]:0)
at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:429)
at org.apache.solr.common.cloud.ZkStateReader.getLeaderUrl(ZkStateReader.java:403)
at org.apache.solr.cloud.BasicDistributedZkTest.testCoreUnloadAndLeaders(BasicDistributedZkTest.java:525)
at org.apache.solr.cloud.BasicDistributedZkTest.doTest(BasicDistributedZkTest.java:337)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:794)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9469 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZkTest
[junit4:junit4] 2> 0 T1842 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /hu_/j
[junit4:junit4] 2> 4 T1842 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZkTest-1360668229211
[junit4:junit4] 2> 5 T1842 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 6 T1843 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 10 T1843 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4] 2> 10 T1843 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4] 2> 10 T1843 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4] 2> 10 T1843 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> 11 T1843 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4] 2> 107 T1842 oasc.ZkTestServer.run start zk server on port:60965
[junit4:junit4] 2> 107 T1842 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60965 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@3f2b49ca
[junit4:junit4] 2> 108 T1842 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 109 T1848 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:60965. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 109 T1848 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:60965, initiating session
[junit4:junit4] 2> 110 T1844 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:60966
[junit4:junit4] 2> 110 T1844 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:60966
[junit4:junit4] 2> 110 T1846 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4] 2> 113 T1846 oazs.ZooKeeperServer.finishSessionInit Established session 0x13cce257e620000 with negotiated timeout 10000 for client /140.211.11.196:60966
[junit4:junit4] 2> 113 T1848 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:60965, sessionid = 0x13cce257e620000, negotiated timeout = 10000
[junit4:junit4] 2> 113 T1849 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3f2b49ca name:ZooKeeperConnection Watcher:127.0.0.1:60965 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 114 T1842 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 114 T1842 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 128 T1847 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13cce257e620000
[junit4:junit4] 2> 131 T1849 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 131 T1844 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:60966 which had sessionid 0x13cce257e620000
[junit4:junit4] 2> 130 T1842 oaz.ZooKeeper.close Session: 0x13cce257e620000 closed
[junit4:junit4] 2> 131 T1842 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60965/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@542ad756
[junit4:junit4] 2> 132 T1842 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 133 T1850 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:60965. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 133 T1850 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:60965, initiating session
[junit4:junit4] 2> 133 T1844 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:60967
[junit4:junit4] 2> 134 T1844 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:60967
[junit4:junit4] 2> 136 T1846 oazs.ZooKeeperServer.finishSessionInit Established session 0x13cce257e620001 with negotiated timeout 10000 for client /140.211.11.196:60967
[junit4:junit4] 2> 136 T1850 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:60965, sessionid = 0x13cce257e620001, negotiated timeout = 10000
[junit4:junit4] 2> 136 T1851 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@542ad756 name:ZooKeeperConnection Watcher:127.0.0.1:60965/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 136 T1842 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 137 T1842 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 142 T1842 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 146 T1842 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 154 T1842 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 158 T1842 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 159 T1842 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 170 T1842 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 171 T1842 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 276 T1842 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 277 T1842 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 280 T1842 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 281 T1842 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 290 T1842 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 291 T1842 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 295 T1842 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 296 T1842 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 299 T1842 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 300 T1842 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 303 T1842 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 304 T1842 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 308 T1842 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 309 T1842 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 312 T1847 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13cce257e620001
[junit4:junit4] 2> 313 T1851 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 313 T1844 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:60967 which had sessionid 0x13cce257e620001
[junit4:junit4] 2> 313 T1842 oaz.ZooKeeper.close Session: 0x13cce257e620001 closed
[junit4:junit4] 2> 511 T1842 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 517 T1842 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:60968
[junit4:junit4] 2> 518 T1842 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 518 T1842 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 519 T1842 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1360668229519
[junit4:junit4] 2> 519 T1842 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1360668229519/solr.xml
[junit4:junit4] 2> 520 T1842 oasc.CoreContainer.<init> New CoreContainer 1764594575
[junit4:junit4] 2> 520 T1842 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1360668229519/'
[junit4:junit4] 2> 521 T1842 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1360668229519/'
[junit4:junit4] 2> 588 T1842 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4] 2> 588 T1842 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 589 T1842 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 589 T1842 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 590 T1842 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 590 T1842 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 591 T1842 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 591 T1842 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 592 T1842 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 592 T1842 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4] 2> 614 T1842 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 635 T1842 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:60965/solr
[junit4:junit4] 2> 636 T1842 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 636 T1842 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60965 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@501162b0
[junit4:junit4] 2> 637 T1842 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 638 T1861 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:60965. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 638 T1861 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:60965, initiating session
[junit4:junit4] 2> 639 T1844 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:60969
[junit4:junit4] 2> 639 T1844 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:60969
[junit4:junit4] 2> 644 T1846 oazs.ZooKeeperServer.finishSessionInit Established session 0x13cce257e620002 with negotiated timeout 20000 for client /140.211.11.196:60969
[junit4:junit4] 2> 644 T1861 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:60965, sessionid = 0x13cce257e620002, negotiated timeout = 20000
[junit4:junit4] 2> 644 T1862 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@501162b0 name:ZooKeeperConnection Watcher:127.0.0.1:60965 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 645 T1842 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 646 T1847 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13cce257e620002
[junit4:junit4] 2> 654 T1862 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 654 T1844 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:60969 which had sessionid 0x13cce257e620002
[junit4:junit4] 2> 654 T1842 oaz.ZooKeeper.close Session: 0x13cce257e620002 closed
[junit4:junit4] 2> 655 T1842 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4] 2> 667 T1842 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60965/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@2e5c31a7
[junit4:junit4] 2> 669 T1842 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 669 T1863 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:60965. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 670 T1863 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:60965, initiating session
[junit4:junit4] 2> 670 T1844 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:60970
[junit4:junit4] 2> 671 T1844 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:60970
[junit4:junit4] 2> 672 T1846 oazs.ZooKeeperServer.finishSessionInit Established session 0x13cce257e620003 with negotiated timeout 20000 for client /140.211.11.196:60970
[junit4:junit4] 2> 672 T1863 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:60965, sessionid = 0x13cce257e620003, negotiated timeout = 20000
[junit4:junit4] 2> 673 T1864 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2e5c31a7 name:ZooKeeperConnection Watcher:127.0.0.1:60965/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 673 T1842 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 677 T1847 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cce257e620003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 684 T1842 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 687 T1842 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60968_hu_%2Fj
[junit4:junit4] 2> 688 T1847 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cce257e620003 type:delete cxid:0x8 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:60968_hu_%2Fj Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:60968_hu_%2Fj
[junit4:junit4] 2> 689 T1842 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:60968_hu_%2Fj
[junit4:junit4] 2> 694 T1842 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 706 T1847 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cce257e620003 type:delete cxid:0x16 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4] 2> 714 T1842 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 718 T1842 oasc.Overseer.start Overseer (id=89172753070030851-127.0.0.1:60968_hu_%2Fj-n_0000000000) starting
[junit4:junit4] 2> 719 T1847 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cce257e620003 type:create cxid:0x1b zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 721 T1847 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cce257e620003 type:create cxid:0x1c zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 728 T1847 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cce257e620003 type:create cxid:0x1d zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 729 T1847 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cce257e620003 type:create cxid:0x1e zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 731 T1866 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 732 T1842 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 745 T1842 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 747 T1865 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 754 T1867 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1360668229519/collection1
[junit4:junit4] 2> 754 T1867 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 755 T1867 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 755 T1867 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 757 T1867 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1360668229519/collection1/'
[junit4:junit4] 2> 758 T1867 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1360668229519/collection1/lib/README' to classloader
[junit4:junit4] 2> 758 T1867 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1360668229519/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 822 T1867 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 907 T1867 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1008 T1867 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 1015 T1867 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 1703 T1867 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 1716 T1867 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1720 T1867 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1736 T1867 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1741 T1867 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1746 T1867 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1748 T1867 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1749 T1867 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1360668229519/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/control/data/
[junit4:junit4] 2> 1749 T1867 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@26058825
[junit4:junit4] 2> 1750 T1867 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 1751 T1867 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/control/data forceNew:false
[junit4:junit4] 2> 1752 T1867 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/control/data
[junit4:junit4] 2> 1752 T1867 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/control/data/index/
[junit4:junit4] 2> 1753 T1867 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1754 T1867 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/control/data/index forceNew:false
[junit4:junit4] 2> 1779 T1867 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@7cbd3163; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 1779 T1867 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 1781 T1867 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/control/data/index
[junit4:junit4] 2> 1782 T1867 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 1785 T1867 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1785 T1867 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 1786 T1867 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1786 T1867 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 1787 T1867 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1787 T1867 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1788 T1867 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1789 T1867 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1789 T1867 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1790 T1867 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 1791 T1867 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 1791 T1867 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1792 T1867 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 1792 T1867 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 1793 T1867 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 1794 T1867 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1794 T1867 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 1795 T1867 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 1796 T1867 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 1796 T1867 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 1797 T1867 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 1798 T1867 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 1799 T1867 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 1799 T1867 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 1800 T1867 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 1801 T1867 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 1825 T1867 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1832 T1867 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 1834 T1867 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4] 2> 1838 T1867 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/control/data
[junit4:junit4] 2> 1841 T1867 oass.SolrIndexSearcher.<init> Opening Searcher@469e42ec main
[junit4:junit4] 2> 1842 T1867 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1843 T1867 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1843 T1867 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 1856 T1867 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 2416 T1868 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@469e42ec main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 2425 T1867 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 2425 T1867 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 2426 T1847 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cce257e620003 type:create cxid:0x54 zxid:0x29 txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4] 2> 3755 T1865 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3756 T1865 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "node_name":"127.0.0.1:60968_hu_%2Fj",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60968/hu_/j"}
[junit4:junit4] 2> 3756 T1865 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 3756 T1865 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 3757 T1847 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cce257e620003 type:create cxid:0x5c zxid:0x2c txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4] 2> 3792 T1864 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 4440 T1867 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 4440 T1867 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:60968/hu_/j collection:control_collection shard:shard1
[junit4:junit4] 2> 4441 T1867 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 4489 T1847 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cce257e620003 type:delete cxid:0x76 zxid:0x36 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4] 2> 4491 T1867 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 4492 T1847 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cce257e620003 type:create cxid:0x77 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 4507 T1867 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 4507 T1867 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 4507 T1867 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:60968/hu_/j/collection1/
[junit4:junit4] 2> 4508 T1867 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 4508 T1867 oasc.SyncStrategy.syncToMe http://127.0.0.1:60968/hu_/j/collection1/ has no replicas
[junit4:junit4] 2> 4508 T1867 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:60968/hu_/j/collection1/
[junit4:junit4] 2> 4508 T1867 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 4515 T1847 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cce257e620003 type:create cxid:0x81 zxid:0x3b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 5298 T1865 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 5322 T1864 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 5385 T1867 oasc.ZkController.register We are http://127.0.0.1:60968/hu_/j/collection1/ and leader is http://127.0.0.1:60968/hu_/j/collection1/
[junit4:junit4] 2> 5385 T1867 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:60968/hu_/j
[junit4:junit4] 2> 5385 T1867 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 5386 T1867 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 5386 T1867 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 5390 T1867 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 5391 T1842 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 5392 T1842 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 5393 T1842 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 5418 T1842 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 5437 T1842 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60965/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@78a97e2a
[junit4:junit4] 2> 5439 T1842 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 5439 T1869 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:60965. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 5440 T1869 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:60965, initiating session
[junit4:junit4] 2> 5440 T1844 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:60971
[junit4:junit4] 2> 5441 T1844 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:60971
[junit4:junit4] 2> 5443 T1846 oazs.ZooKeeperServer.finishSessionInit Established session 0x13cce257e620004 with negotiated timeout 10000 for client /140.211.11.196:60971
[junit4:junit4] 2> 5443 T1869 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:60965, sessionid = 0x13cce257e620004, negotiated timeout = 10000
[junit4:junit4] 2> 5443 T1870 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@78a97e2a name:ZooKeeperConnection Watcher:127.0.0.1:60965/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 5444 T1842 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 5445 T1842 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 5447 T1842 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 5637 T1842 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 5641 T1842 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:60972
[junit4:junit4] 2> 5642 T1842 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 5643 T1842 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 5643 T1842 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1360668234654
[junit4:junit4] 2> 5643 T1842 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1360668234654/solr.xml
[junit4:junit4] 2> 5644 T1842 oasc.CoreContainer.<init> New CoreContainer 1188406593
[junit4:junit4] 2> 5645 T1842 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1360668234654/'
[junit4:junit4] 2> 5645 T1842 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1360668234654/'
[junit4:junit4] 2> 5719 T1842 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4] 2> 5720 T1842 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 5720 T1842 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 5721 T1842 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 5721 T1842 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 5722 T1842 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 5722 T1842 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 5723 T1842 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 5723 T1842 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 5724 T1842 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4] 2> 5746 T1842 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 5768 T1842 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:60965/solr
[junit4:junit4] 2> 5769 T1842 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 5769 T1842 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60965 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1fad12f0
[junit4:junit4] 2> 5770 T1842 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 5771 T1880 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:60965. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 5771 T1880 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:60965, initiating session
[junit4:junit4] 2> 5771 T1844 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:60973
[junit4:junit4] 2> 5772 T1844 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:60973
[junit4:junit4] 2> 5774 T1880 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:60965, sessionid = 0x13cce257e620005, negotiated timeout = 20000
[junit4:junit4] 2> 5774 T1846 oazs.ZooKeeperServer.finishSessionInit Established session 0x13cce257e620005 with negotiated timeout 20000 for client /140.211.11.196:60973
[junit4:junit4] 2> 5774 T1881 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1fad12f0 name:ZooKeeperConnection Watcher:127.0.0.1:60965 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 5774 T1842 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 5776 T1847 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13cce257e620005
[junit4:junit4] 2> 5777 T1881 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 5777 T1844 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:60973 which had sessionid 0x13cce257e620005
[junit4:junit4] 2> 5777 T1842 oaz.ZooKeeper.close Session: 0x13cce257e620005 closed
[junit4:junit4] 2> 5778 T1842 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4] 2> 5789 T1842 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60965/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@ab5f09c
[junit4:junit4] 2> 5791 T1842 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 5791 T1882 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:60965. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 5791 T1882 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:60965, initiating session
[junit4:junit4] 2> 5792 T1844 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:60974
[junit4:junit4] 2> 5792 T1844 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:60974
[junit4:junit4] 2> 5794 T1846 oazs.ZooKeeperServer.finishSessionInit Established session 0x13cce257e620006 with negotiated timeout 20000 for client /140.211.11.196:60974
[junit4:junit4] 2> 5794 T1882 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:60965, sessionid = 0x13cce257e620006, negotiated timeout = 20000
[junit4:junit4] 2> 5794 T1883 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ab5f09c name:ZooKeeperConnection Watcher:127.0.0.1:60965/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 5794 T1842 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 5795 T1847 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cce257e620006 type:create cxid:0x1 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 5797 T1847 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cce257e620006 type:create cxid:0x2 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 5805 T1842 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 5808 T1842 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60972_hu_%2Fj
[junit4:junit4] 2> 5809 T1847 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cce257e620006 type:delete cxid:0x9 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:60972_hu_%2Fj Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:60972_hu_%2Fj
[junit4:junit4] 2> 5810 T1842 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:60972_hu_%2Fj
[junit4:junit4] 2> 5814 T1864 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 5814 T1870 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 5814 T1883 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 5816 T1864 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 5823 T1884 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1360668234654/collection1
[junit4:junit4] 2> 5824 T1884 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 5824 T1884 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 5824 T1884 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 5826 T1884 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1360668234654/collection1/'
[junit4:junit4] 2> 5827 T1884 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1360668234654/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 5828 T1884 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1360668234654/collection1/lib/README' to classloader
[junit4:junit4] 2> 5886 T1884 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 5962 T1884 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 6063 T1884 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 6071 T1884 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 6824 T1884 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 6837 T1865 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 6837 T1884 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 6838 T1865 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "node_name":"127.0.0.1:60968_hu_%2Fj",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60968/hu_/j"}
[junit4:junit4] 2> 6841 T1884 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 6857 T1870 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6857 T1883 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6857 T1864 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6873 T1884 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 6879 T1884 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 6884 T1884 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 6885 T1884 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 6887 T1884 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1360668234654/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty1/
[junit4:junit4] 2> 6887 T1884 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@26058825
[junit4:junit4] 2> 6888 T1884 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 6889 T1884 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty1 forceNew:false
[junit4:junit4] 2> 6889 T1884 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty1
[junit4:junit4] 2> 6890 T1884 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty1/index/
[junit4:junit4] 2> 6890 T1884 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 6891 T1884 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty1/index forceNew:false
[junit4:junit4] 2> 6900 T1884 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6c0dbbd8; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 6900 T1884 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 6901 T1884 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty1/index
[junit4:junit4] 2> 6902 T1884 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 6904 T1884 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 6905 T1884 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 6905 T1884 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 6905 T1884 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 6906 T1884 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 6906 T1884 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 6907 T1884 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 6908 T1884 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 6908 T1884 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 6909 T1884 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 6910 T1884 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 6910 T1884 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 6911 T1884 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 6911 T1884 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 6911 T1884 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 6912 T1884 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 6913 T1884 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 6913 T1884 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 6914 T1884 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 6914 T1884 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 6915 T1884 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 6916 T1884 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 6916 T1884 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 6917 T1884 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 6917 T1884 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 6918 T1884 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 6932 T1884 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 6937 T1884 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 6939 T1884 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4] 2> 6942 T1884 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty1
[junit4:junit4] 2> 6944 T1884 oass.SolrIndexSearcher.<init> Opening Searcher@748d43cf main
[junit4:junit4] 2> 6945 T1884 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 6945 T1884 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 6946 T1884 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 6955 T1884 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 6999 T1885 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@748d43cf main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 7006 T1884 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 7006 T1884 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 8363 T1865 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 8364 T1865 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:60972_hu_%2Fj",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60972/hu_/j"}
[junit4:junit4] 2> 8364 T1865 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 8364 T1865 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 8382 T1883 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8382 T1870 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8382 T1864 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9010 T1884 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 9010 T1884 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:60972/hu_/j collection:collection1 shard:shard1
[junit4:junit4] 2> 9011 T1884 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 9031 T1847 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cce257e620006 type:delete cxid:0x47 zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4] 2> 9036 T1884 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 9037 T1847 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cce257e620006 type:create cxid:0x48 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 9045 T1884 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 9046 T1884 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 9046 T1884 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:60972/hu_/j/collection1/
[junit4:junit4] 2> 9046 T1884 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 9046 T1884 oasc.SyncStrategy.syncToMe http://127.0.0.1:60972/hu_/j/collection1/ has no replicas
[junit4:junit4] 2> 9047 T1884 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:60972/hu_/j/collection1/
[junit4:junit4] 2> 9047 T1884 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 9053 T1847 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cce257e620006 type:create cxid:0x52 zxid:0x60 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 9920 T1865 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 9977 T1870 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9977 T1864 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9977 T1883 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 10031 T1884 oasc.ZkController.register We are http://127.0.0.1:60972/hu_/j/collection1/ and leader is http://127.0.0.1:60972/hu_/j/collection1/
[junit4:junit4] 2> 10031 T1884 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:60972/hu_/j
[junit4:junit4] 2> 10031 T1884 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 10032 T1884 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 10032 T1884 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 10035 T1884 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 10036 T1842 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 10037 T1842 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 10037 T1842 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 10238 T1842 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 10241 T1842 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:60975
[junit4:junit4] 2> 10242 T1842 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 10243 T1842 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 10243 T1842 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1360668239259
[junit4:junit4] 2> 10244 T1842 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1360668239259/solr.xml
[junit4:junit4] 2> 10244 T1842 oasc.CoreContainer.<init> New CoreContainer 13723955
[junit4:junit4] 2> 10245 T1842 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1360668239259/'
[junit4:junit4] 2> 10245 T1842 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1360668239259/'
[junit4:junit4] 2> 10315 T1842 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4] 2> 10316 T1842 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 10316 T1842 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 10317 T1842 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 10317 T1842 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 10318 T1842 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 10318 T1842 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 10319 T1842 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 10319 T1842 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 10320 T1842 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4] 2> 10344 T1842 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 10368 T1842 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:60965/solr
[junit4:junit4] 2> 10369 T1842 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 10370 T1842 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60965 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@47d38c14
[junit4:junit4] 2> 10371 T1842 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 10371 T1895 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:60965. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 10372 T1895 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:60965, initiating session
[junit4:junit4] 2> 10372 T1844 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:60976
[junit4:junit4] 2> 10372 T1844 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:60976
[junit4:junit4] 2> 10374 T1846 oazs.ZooKeeperServer.finishSessionInit Established session 0x13cce257e620007 with negotiated timeout 20000 for client /140.211.11.196:60976
[junit4:junit4] 2> 10374 T1895 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:60965, sessionid = 0x13cce257e620007, negotiated timeout = 20000
[junit4:junit4] 2> 10375 T1896 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@47d38c14 name:ZooKeeperConnection Watcher:127.0.0.1:60965 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 10375 T1842 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 10376 T1847 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13cce257e620007
[junit4:junit4] 2> 10377 T1896 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 10377 T1844 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:60976 which had sessionid 0x13cce257e620007
[junit4:junit4] 2> 10377 T1842 oaz.ZooKeeper.close Session: 0x13cce257e620007 closed
[junit4:junit4] 2> 10378 T1842 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4] 2> 10390 T1842 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60965/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@34c427b4
[junit4:junit4] 2> 10391 T1842 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 10392 T1897 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:60965. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 10392 T1897 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:60965, initiating session
[junit4:junit4] 2> 10392 T1844 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:60977
[junit4:junit4] 2> 10393 T1844 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:60977
[junit4:junit4] 2> 10395 T1846 oazs.ZooKeeperServer.finishSessionInit Established session 0x13cce257e620008 with negotiated timeout 20000 for client /140.211.11.196:60977
[junit4:junit4] 2> 10395 T1897 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:60965, sessionid = 0x13cce257e620008, negotiated timeout = 20000
[junit4:junit4] 2> 10395 T1898 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@34c427b4 name:ZooKeeperConnection Watcher:127.0.0.1:60965/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 10395 T1842 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 10396 T1847 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cce257e620008 type:create cxid:0x1 zxid:0x6d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 10398 T1847 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cce257e620008 type:create cxid:0x2 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 10406 T1842 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 10409 T1842 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60975_hu_%2Fj
[junit4:junit4] 2> 10409 T1847 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cce257e620008 type:delete cxid:0x9 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:60975_hu_%2Fj Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:60975_hu_%2Fj
[junit4:junit4] 2> 10411 T1842 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:60975_hu_%2Fj
[junit4:junit4] 2> 10414 T1864 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 10414 T1883 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 10414 T1870 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 10414 T1898 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 10415 T1870 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 10416 T1864 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 10416 T1883 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 10424 T1899 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1360668239259/collection1
[junit4:junit4] 2> 10424 T1899 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 10425 T1899 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 10425 T1899 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 10427 T1899 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1360668239259/collection1/'
[junit4:junit4] 2> 10428 T1899 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1360668239259/collection1/lib/README' to classloader
[junit4:junit4] 2> 10429 T1899 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1360668239259/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 10488 T1899 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 10563 T1899 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 10664 T1899 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 10671 T1899 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 11322 T1899 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 11336 T1899 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 11340 T1899 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 11359 T1899 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 11365 T1899 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 11371 T1899 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 11372 T1899 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 11374 T1899 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1360668239259/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty2/
[junit4:junit4] 2> 11374 T1899 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@26058825
[junit4:junit4] 2> 11375 T1899 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 11377 T1899 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty2 forceNew:false
[junit4:junit4] 2> 11377 T1899 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty2
[junit4:junit4] 2> 11378 T1899 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty2/index/
[junit4:junit4] 2> 11379 T1899 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 11380 T1899 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty2/index forceNew:false
[junit4:junit4] 2> 11388 T1899 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@12ed2889; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 11389 T1899 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 11390 T1899 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty2/index
[junit4:junit4] 2> 11390 T1899 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 11393 T1899 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 11393 T1899 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 11394 T1899 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 11394 T1899 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 11395 T1899 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 11395 T1899 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 11396 T1899 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 11396 T1899 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 11397 T1899 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 11398 T1899 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 11398 T1899 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 11399 T1899 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 11399 T1899 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 11399 T1899 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 11400 T1899 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 11401 T1899 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 11401 T1899 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 11402 T1899 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 11402 T1899 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 11403 T1899 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 11404 T1899 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 11404 T1899 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 11405 T1899 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 11405 T1899 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 11406 T1899 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 11407 T1899 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 11423 T1899 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 11429 T1899 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 11431 T1899 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4] 2> 11434 T1899 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty2
[junit4:junit4] 2> 11436 T1899 oass.SolrIndexSearcher.<init> Opening Searcher@b78fe2 main
[junit4:junit4] 2> 11437 T1899 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 11438 T1899 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 11438 T1899 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 11448 T1899 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 11486 T1865 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 11488 T1865 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:60972_hu_%2Fj",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60972/hu_/j"}
[junit4:junit4] 2> 11513 T1898 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11513 T1870 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11513 T1864 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11513 T1883 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11517 T1900 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@b78fe2 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 11523 T1899 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 11523 T1899 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 13021 T1865 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 13022 T1865 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:60975_hu_%2Fj",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60975/hu_/j"}
[junit4:junit4] 2> 13022 T1865 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 13022 T1865 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4] 2> 13085 T1870 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13085 T1883 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13085 T1898 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13086 T1864 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13527 T1899 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 13527 T1899 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:60975/hu_/j collection:collection1 shard:shard2
[junit4:junit4] 2> 13528 T1899 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 13554 T1847 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cce257e620008 type:delete cxid:0x46 zxid:0x7e txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard2 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard2
[junit4:junit4] 2> 13556 T1899 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 13556 T1847 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cce257e620008 type:create cxid:0x47 zxid:0x7f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 13567 T1899 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 13567 T1899 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 13568 T1899 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:60975/hu_/j/collection1/
[junit4:junit4] 2> 13568 T1899 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 13568 T1899 oasc.SyncStrategy.syncToMe http://127.0.0.1:60975/hu_/j/collection1/ has no replicas
[junit4:junit4] 2> 13568 T1899 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:60975/hu_/j/collection1/
[junit4:junit4] 2> 13569 T1899 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 13573 T1847 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cce257e620008 type:create cxid:0x50 zxid:0x82 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 14593 T1865 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 14642 T1864 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14642 T1898 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14642 T1883 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14642 T1870 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14698 T1899 oasc.ZkController.register We are http://127.0.0.1:60975/hu_/j/collection1/ and leader is http://127.0.0.1:60975/hu_/j/collection1/
[junit4:junit4] 2> 14698 T1899 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:60975/hu_/j
[junit4:junit4] 2> 14698 T1899 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 14699 T1899 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 14699 T1899 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 14702 T1899 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 14703 T1842 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 14704 T1842 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 14705 T1842 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 14909 T1842 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 14913 T1842 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:60978
[junit4:junit4] 2> 14913 T1842 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 14914 T1842 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 14914 T1842 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1360668243927
[junit4:junit4] 2> 14915 T1842 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1360668243927/solr.xml
[junit4:junit4] 2> 14915 T1842 oasc.CoreContainer.<init> New CoreContainer 3018306
[junit4:junit4] 2> 14916 T1842 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1360668243927/'
[junit4:junit4] 2> 14917 T1842 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1360668243927/'
[junit4:junit4] 2> 14987 T1842 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4] 2> 14988 T1842 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 14989 T1842 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 14989 T1842 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 14990 T1842 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 14990 T1842 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 14991 T1842 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 14991 T1842 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 14992 T1842 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 14992 T1842 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4] 2> 15014 T1842 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 15034 T1842 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:60965/solr
[junit4:junit4] 2> 15035 T1842 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 15035 T1842 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60965 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@3da60f25
[junit4:junit4] 2> 15037 T1842 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 15037 T1910 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:60965. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 15038 T1910 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:60965, initiating session
[junit4:junit4] 2> 15038 T1844 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:60979
[junit4:junit4] 2> 15038 T1844 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:60979
[junit4:junit4] 2> 15040 T1846 oazs.ZooKeeperServer.finishSessionInit Established session 0x13cce257e620009 with negotiated timeout 20000 for client /140.211.11.196:60979
[junit4:junit4] 2> 15040 T1910 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:60965, sessionid = 0x13cce257e620009, negotiated timeout = 20000
[junit4:junit4] 2> 15041 T1911 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3da60f25 name:ZooKeeperConnection Watcher:127.0.0.1:60965 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 15041 T1842 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 15042 T1847 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13cce257e620009
[junit4:junit4] 2> 15055 T1911 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 15055 T1844 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:60979 which had sessionid 0x13cce257e620009
[junit4:junit4] 2> 15055 T1842 oaz.ZooKeeper.close Session: 0x13cce257e620009 closed
[junit4:junit4] 2> 15055 T1842 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4] 2> 15068 T1842 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60965/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@4382830b
[junit4:junit4] 2> 15069 T1842 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 15069 T1912 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:60965. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 15070 T1912 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:60965, initiating session
[junit4:junit4] 2> 15070 T1844 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:60980
[junit4:junit4] 2> 15071 T1844 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:60980
[junit4:junit4] 2> 15072 T1846 oazs.ZooKeeperServer.finishSessionInit Established session 0x13cce257e62000a with negotiated timeout 20000 for client /140.211.11.196:60980
[junit4:junit4] 2> 15072 T1912 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:60965, sessionid = 0x13cce257e62000a, negotiated timeout = 20000
[junit4:junit4] 2> 15073 T1913 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4382830b name:ZooKeeperConnection Watcher:127.0.0.1:60965/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 15073 T1842 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 15074 T1847 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cce257e62000a type:create cxid:0x1 zxid:0x8f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 15078 T1847 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cce257e62000a type:create cxid:0x2 zxid:0x90 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 15080 T1842 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 15083 T1842 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60978_hu_%2Fj
[junit4:junit4] 2> 15084 T1847 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cce257e62000a type:delete cxid:0x9 zxid:0x91 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:60978_hu_%2Fj Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:60978_hu_%2Fj
[junit4:junit4] 2> 15086 T1842 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:60978_hu_%2Fj
[junit4:junit4] 2> 15089 T1883 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 15089 T1864 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 15090 T1870 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 15090 T1913 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 15091 T1870 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15091 T1898 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 15091 T1898 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15093 T1883 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 15093 T1864 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 15099 T1914 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1360668243927/collection1
[junit4:junit4] 2> 15100 T1914 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 15100 T1914 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 15101 T1914 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 15102 T1914 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1360668243927/collection1/'
[junit4:junit4] 2> 15104 T1914 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1360668243927/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 15105 T1914 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1360668243927/collection1/lib/README' to classloader
[junit4:junit4] 2> 15165 T1914 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 15249 T1914 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 15350 T1914 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 15357 T1914 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 16019 T1914 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 16032 T1914 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 16036 T1914 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 16052 T1914 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 16058 T1914 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 16063 T1914 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 16064 T1914 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 16066 T1914 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1360668243927/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty3/
[junit4:junit4] 2> 16066 T1914 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@26058825
[junit4:junit4] 2> 16067 T1914 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 16068 T1914 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty3 forceNew:false
[junit4:junit4] 2> 16069 T1914 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty3
[junit4:junit4] 2> 16069 T1914 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty3/index/
[junit4:junit4] 2> 16070 T1914 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 16071 T1914 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty3/index forceNew:false
[junit4:junit4] 2> 16078 T1914 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@2978f04; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 16078 T1914 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 16080 T1914 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty3/index
[junit4:junit4] 2> 16080 T1914 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 16082 T1914 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 16083 T1914 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 16083 T1914 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 16084 T1914 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 16084 T1914 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 16084 T1914 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 16085 T1914 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 16086 T1914 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 16086 T1914 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 16087 T1914 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 16087 T1914 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 16088 T1914 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 16089 T1914 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 16089 T1914 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 16089 T1914 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 16090 T1914 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 16090 T1914 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 16091 T1914 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 16092 T1914 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 16092 T1914 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 16093 T1914 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 16093 T1914 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 16094 T1914 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 16095 T1914 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 16095 T1914 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 16096 T1914 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 16109 T1914 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 16114 T1914 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 16115 T1914 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4] 2> 16118 T1914 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty3
[junit4:junit4] 2> 16120 T1914 oass.SolrIndexSearcher.<init> Opening Searcher@2ebad0d7 main
[junit4:junit4] 2> 16121 T1914 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 16121 T1914 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 16122 T1914 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 16130 T1914 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 16157 T1865 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 16158 T1865 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:60975_hu_%2Fj",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60975/hu_/j"}
[junit4:junit4] 2> 16176 T1864 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16176 T1898 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16176 T1870 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16176 T1913 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16176 T1883 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16201 T1915 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2ebad0d7 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 16208 T1914 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 16208 T1914 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 17690 T1865 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 17691 T1865 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:60978_hu_%2Fj",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60978/hu_/j"}
[junit4:junit4] 2> 17691 T1865 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 17692 T1865 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 17718 T1864 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17718 T1870 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17718 T1913 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17718 T1883 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17718 T1898 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 18212 T1914 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 18212 T1914 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:60978/hu_/j collection:collection1 shard:shard1
[junit4:junit4] 2> 18217 T1914 oasc.ZkController.register We are http://127.0.0.1:60978/hu_/j/collection1/ and leader is http://127.0.0.1:60972/hu_/j/collection1/
[junit4:junit4] 2> 18217 T1914 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:60978/hu_/j
[junit4:junit4] 2> 18217 T1914 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 18218 T1914 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C143 name=collection1 org.apache.solr.core.SolrCore@7c064cc url=http://127.0.0.1:60978/hu_/j/collection1 node=127.0.0.1:60978_hu_%2Fj C143_STATE=coll:collection1 core:collection1 props:{shard=null, roles=null, state=down, core=collection1, collection=collection1, node_name=127.0.0.1:60978_hu_%2Fj, base_url=http://127.0.0.1:60978/hu_/j}
[junit4:junit4] 2> 18219 T1916 C143 P60978 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 18219 T1916 C143 P60978 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 18220 T1914 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 18220 T1916 C143 P60978 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 18220 T1916 C143 P60978 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 18221 T1842 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 18221 T1842 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 18222 T1916 C143 P60978 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 18222 T1842 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 18424 T1842 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 18427 T1842 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:60982
[junit4:junit4] 2> 18428 T1842 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 18429 T1842 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 18429 T1842 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1360668247447
[junit4:junit4] 2> 18430 T1842 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1360668247447/solr.xml
[junit4:junit4] 2> 18430 T1842 oasc.CoreContainer.<init> New CoreContainer 1786184522
[junit4:junit4] 2> 18431 T1842 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1360668247447/'
[junit4:junit4] 2> 18431 T1842 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1360668247447/'
[junit4:junit4] 2> 18498 T1842 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4] 2> 18499 T1842 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 18499 T1842 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 18500 T1842 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 18501 T1842 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 18501 T1842 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 18502 T1842 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 18502 T1842 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 18503 T1842 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 18503 T1842 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4] 2> 18527 T1842 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 18551 T1842 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:60965/solr
[junit4:junit4] 2> 18552 T1842 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 18552 T1842 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60965 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@766d257
[junit4:junit4] 2> 18553 T1842 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 18554 T1926 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:60965. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 18554 T1926 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:60965, initiating session
[junit4:junit4] 2> 18555 T1844 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:60983
[junit4:junit4] 2> 18555 T1844 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:60983
[junit4:junit4] 2> 18561 T1846 oazs.ZooKeeperServer.finishSessionInit Established session 0x13cce257e62000b with negotiated timeout 20000 for client /140.211.11.196:60983
[junit4:junit4] 2> 18561 T1926 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:60965, sessionid = 0x13cce257e62000b, negotiated timeout = 20000
[junit4:junit4] 2> 18562 T1927 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@766d257 name:ZooKeeperConnection Watcher:127.0.0.1:60965 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 18562 T1842 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 18563 T1847 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13cce257e62000b
[junit4:junit4] 2> 18565 T1927 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 18565 T1844 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:60983 which had sessionid 0x13cce257e62000b
[junit4:junit4] 2> 18565 T1842 oaz.ZooKeeper.close Session: 0x13cce257e62000b closed
[junit4:junit4] 2> 18565 T1842 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4] 2> 18579 T1842 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60965/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@cddb3b5
[junit4:junit4] 2> 18580 T1842 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 18581 T1928 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:60965. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 18581 T1928 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:60965, initiating session
[junit4:junit4] 2> 18582 T1844 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:60984
[junit4:junit4] 2> 18582 T1844 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:60984
[junit4:junit4] 2> 18584 T1846 oazs.ZooKeeperServer.finishSessionInit Established session 0x13cce257e62000c with negotiated timeout 20000 for client /140.211.11.196:60984
[junit4:junit4] 2> 18584 T1928 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:60965, sessionid = 0x13cce257e62000c, negotiated timeout = 20000
[junit4:junit4] 2> 18584 T1929 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@cddb3b5 name:ZooKeeperConnection Watcher:127.0.0.1:60965/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 18584 T1842 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 18585 T1847 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cce257e62000c type:create cxid:0x1 zxid:0xa2 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 18587 T1847 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cce257e62000c type:create cxid:0x2 zxid:0xa3 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 18596 T1842 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 18599 T1842 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60982_hu_%2Fj
[junit4:junit4] 2> 18600 T1847 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cce257e62000c type:delete cxid:0x9 zxid:0xa4 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:60982_hu_%2Fj Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:60982_hu_%2Fj
[junit4:junit4] 2> 18602 T1842 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:60982_hu_%2Fj
[junit4:junit4] 2> 18605 T1864 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 18605 T1883 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 18606 T1913 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 18606 T1898 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 18606 T1913 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18606 T1898 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18606 T1929 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 18606 T1870 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 18607 T1870 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18608 T1883 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 18610 T1864 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 18620 T1930 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1360668247447/collection1
[junit4:junit4] 2> 18621 T1930 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 18622 T1930 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 18622 T1930 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 18623 T1930 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1360668247447/collection1/'
[junit4:junit4] 2> 18625 T1930 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1360668247447/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 18626 T1930 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1360668247447/collection1/lib/README' to classloader
[junit4:junit4] 2> 18690 T1930 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 18779 T1930 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 18880 T1930 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 18887 T1930 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 19225 T1865 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 19226 T1865 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:60978_hu_%2Fj",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60978/hu_/j"}
[junit4:junit4] 2> 19244 T1883 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19244 T1864 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19244 T1929 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19244 T1913 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19244 T1898 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19244 T1870 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19524 T1930 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 19532 T1930 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 19535 T1930 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 19548 T1930 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 19552 T1930 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 19556 T1930 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 19557 T1930 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 19558 T1930 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1360668247447/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty4/
[junit4:junit4] 2> 19558 T1930 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@26058825
[junit4:junit4] 2> 19559 T1930 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 19559 T1930 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty4 forceNew:false
[junit4:junit4] 2> 19560 T1930 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty4
[junit4:junit4] 2> 19560 T1930 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty4/index/
[junit4:junit4] 2> 19560 T1930 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 19561 T1930 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty4/index forceNew:false
[junit4:junit4] 2> 19566 T1930 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@5a6a7c9; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 19566 T1930 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 19566 T1930 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty4/index
[junit4:junit4] 2> 19567 T1930 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 19569 T1930 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 19569 T1930 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 19569 T1930 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 19569 T1930 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 19570 T1930 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 19570 T1930 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 19570 T1930 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 19571 T1930 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 19571 T1930 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 19572 T1930 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 19572 T1930 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 19572 T1930 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 19573 T1930 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 19573 T1930 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 19573 T1930 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 19574 T1930 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 19574 T1930 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 19574 T1930 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 19575 T1930 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 19575 T1930 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 19576 T1930 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 19576 T1930 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 19576 T1930 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 19577 T1930 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 19577 T1930 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 19578 T1930 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 19586 T1930 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 19589 T1930 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 19591 T1930 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4] 2> 19592 T1930 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty4
[junit4:junit4] 2> 19594 T1930 oass.SolrIndexSearcher.<init> Opening Searcher@186674a3 main
[junit4:junit4] 2> 19594 T1930 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 19595 T1930 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 19595 T1930 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 19600 T1930 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 19659 T1931 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@186674a3 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 19666 T1930 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 19666 T1930 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 20753 T1865 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 20754 T1865 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:60982_hu_%2Fj",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60982/hu_/j"}
[junit4:junit4] 2> 20754 T1865 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 20754 T1865 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4] 2> 20775 T1864 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20776 T1898 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20776 T1929 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20776 T1870 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20776 T1913 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20776 T1883 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21670 T1930 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 21670 T1930 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:60982/hu_/j collection:collection1 shard:shard2
[junit4:junit4] 2> 21675 T1930 oasc.ZkController.register We are http://127.0.0.1:60982/hu_/j/collection1/ and leader is http://127.0.0.1:60975/hu_/j/collection1/
[junit4:junit4] 2> 21675 T1930 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:60982/hu_/j
[junit4:junit4] 2> 21676 T1930 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 21676 T1930 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C144 name=collection1 org.apache.solr.core.SolrCore@1eb109df url=http://127.0.0.1:60982/hu_/j/collection1 node=127.0.0.1:60982_hu_%2Fj C144_STATE=coll:collection1 core:collection1 props:{shard=null, roles=null, state=down, core=collection1, collection=collection1, node_name=127.0.0.1:60982_hu_%2Fj, base_url=http://127.0.0.1:60982/hu_/j}
[junit4:junit4] 2> 21677 T1932 C144 P60982 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 21677 T1930 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 21678 T1932 C144 P60982 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 21678 T1932 C144 P60982 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 21678 T1932 C144 P60982 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 21679 T1842 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 21679 T1842 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 21680 T1842 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 21682 T1932 C144 P60982 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 21706 T1842 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 21708 T1842 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):230
[junit4:junit4] 2> 21709 T1842 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C143_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:60978_hu_%2Fj, base_url=http://127.0.0.1:60978/hu_/j}
[junit4:junit4] 2> 22246 T1916 C143 P60978 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:60972/hu_/j/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 22246 T1916 C143 P60978 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:60978/hu_/j START replicas=[http://127.0.0.1:60972/hu_/j/collection1/] nUpdates=100
[junit4:junit4] 2> 22247 T1916 C143 P60978 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 22247 T1916 C143 P60978 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 22247 T1916 C143 P60978 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 22247 T1916 C143 P60978 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 22248 T1916 C143 P60978 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 22248 T1916 C143 P60978 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:60972/hu_/j/collection1/. core=collection1
[junit4:junit4] 2> 22248 T1916 C143 P60978 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C145 name=collection1 org.apache.solr.core.SolrCore@5a1e20d6 url=http://127.0.0.1:60972/hu_/j/collection1 node=127.0.0.1:60972_hu_%2Fj C145_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:60972_hu_%2Fj, base_url=http://127.0.0.1:60972/hu_/j, leader=true}
[junit4:junit4] 2> 22259 T1874 C145 P60972 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 22264 T1875 C145 P60972 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4] 2> 22265 T1875 C145 P60972 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty1
[junit4:junit4] 2> 22272 T1875 C145 P60972 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6c0dbbd8; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 22273 T1875 C145 P60972 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 22280 T1875 C145 P60972 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6c0dbbd8; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6c0dbbd8; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 22281 T1875 C145 P60972 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 22282 T1865 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 22282 T1875 C145 P60972 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty1
[junit4:junit4] 2> 22283 T1865 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:60982_hu_%2Fj",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60982/hu_/j"}
[junit4:junit4] 2> 22283 T1875 C145 P60972 oass.SolrIndexSearcher.<init> Opening Searcher@339790f9 realtime
[junit4:junit4] 2> 22284 T1875 C145 P60972 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 22284 T1875 C145 P60972 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 21
[junit4:junit4] 2> 22286 T1916 C143 P60978 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 22286 T1916 C143 P60978 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 22289 T1876 C145 P60972 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 22289 T1876 C145 P60972 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=2
[junit4:junit4] 2> 22290 T1916 C143 P60978 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 22291 T1916 C143 P60978 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 22291 T1916 C143 P60978 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 22293 T1876 C145 P60972 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty1
[junit4:junit4] 2> 22295 T1876 C145 P60972 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty1/index
[junit4:junit4] 2> 22295 T1876 C145 P60972 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=2
[junit4:junit4] 2> 22296 T1916 C143 P60978 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 22297 T1864 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 22297 T1870 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 22297 T1929 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 22297 T1913 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 22297 T1883 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 22297 T1898 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 22298 T1916 C143 P60978 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty3/index.20130212232411502 forceNew:false
[junit4:junit4] 2> 22300 T1916 C143 P60978 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty3
[junit4:junit4] 2> 22301 T1916 C143 P60978 oash.SnapPuller.fetchLatestIndex Starting download to RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty3/index.20130212232411502 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5405d518; maxCacheMB=48.0 maxMergeSizeMB=4.0)) fullCopy=true
[junit4:junit4] 2> 22305 T1876 C145 P60972 REQ /replication {file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 22307 T1916 C143 P60978 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty3/index
[junit4:junit4] 2> 22307 T1916 C143 P60978 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 22308 T1916 C143 P60978 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20130212232411502
[junit4:junit4] 2> 22310 T1916 C143 P60978 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty3
[junit4:junit4] 2> 22310 T1916 C143 P60978 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty3
[junit4:junit4] 2> 22310 T1916 C143 P60978 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty3/index/ new=./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty3/index.20130212232411502
[junit4:junit4] 2> 22315 T1916 C143 P60978 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty3/index.20130212232411502 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5405d518; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 22316 T1916 C143 P60978 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 22318 T1916 C143 P60978 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty3
[junit4:junit4] 2> 22318 T1916 C143 P60978 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 22318 T1916 C143 P60978 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 22319 T1916 C143 P60978 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4] 2> 22320 T1916 C143 P60978 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty3/index.20130212232411502
[junit4:junit4] 2> 22321 T1916 C143 P60978 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty3
[junit4:junit4] 2> 22325 T1916 C143 P60978 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty3/index.20130212232411502 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5405d518; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 22325 T1916 C143 P60978 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 22325 T1916 C143 P60978 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 22326 T1916 C143 P60978 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty3
[junit4:junit4] 2> 22326 T1916 C143 P60978 oass.SolrIndexSearcher.<init> Opening Searcher@2ca61a16 main
[junit4:junit4] 2> 22328 T1915 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2ca61a16 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 22329 T1915 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty3/index
[junit4:junit4] 2> 22329 T1916 C143 P60978 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4] 2> 22334 T1916 C143 P60978 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty3/index.20130212232411502 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5405d518; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty3/index.20130212232411502 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5405d518; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> 22334 T1916 C143 P60978 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4] 2> 22335 T1916 C143 P60978 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty3
[junit4:junit4] 2> 22335 T1916 C143 P60978 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 22336 T1916 C143 P60978 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty3/index.20130212232411502
[junit4:junit4] 2> 22336 T1916 C143 P60978 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty3/index
[junit4:junit4] 2> 22336 T1916 C143 P60978 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 22336 T1916 C143 P60978 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 22336 T1916 C143 P60978 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 22337 T1916 C143 P60978 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 22344 T1916 C143 P60978 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 22713 T1842 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 23715 T1842 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 23809 T1865 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 23810 T1865 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:60978_hu_%2Fj",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60978/hu_/j"}
[junit4:junit4] 2> 23858 T1913 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23858 T1883 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23858 T1898 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23858 T1929 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23858 T1870 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23858 T1864 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> C144_STATE=coll:collection1 core:collection1 props:{shard=shard2, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:60982_hu_%2Fj, base_url=http://127.0.0.1:60982/hu_/j}
[junit4:junit4] 2> 24708 T1932 C144 P60982 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:60975/hu_/j/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 24708 T1932 C144 P60982 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:60982/hu_/j START replicas=[http://127.0.0.1:60975/hu_/j/collection1/] nUpdates=100
[junit4:junit4] 2> 24709 T1932 C144 P60982 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 24709 T1932 C144 P60982 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 24709 T1932 C144 P60982 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 24709 T1932 C144 P60982 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 24710 T1932 C144 P60982 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 24710 T1932 C144 P60982 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:60975/hu_/j/collection1/. core=collection1
[junit4:junit4] 2> 24710 T1932 C144 P60982 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 24718 T1842 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> ASYNC NEW_CORE C146 name=collection1 org.apache.solr.core.SolrCore@7a53a543 url=http://127.0.0.1:60975/hu_/j/collection1 node=127.0.0.1:60975_hu_%2Fj C146_STATE=coll:collection1 core:collection1 props:{shard=shard2, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:60975_hu_%2Fj, base_url=http://127.0.0.1:60975/hu_/j, leader=true}
[junit4:junit4] 2> 24722 T1889 C146 P60975 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 24729 T1890 C146 P60975 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4] 2> 24730 T1890 C146 P60975 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty2
[junit4:junit4] 2> 24736 T1890 C146 P60975 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@12ed2889; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 24736 T1890 C146 P60975 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 24742 T1890 C146 P60975 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@12ed2889; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@12ed2889; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 24743 T1890 C146 P60975 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 24744 T1890 C146 P60975 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty2
[junit4:junit4] 2> 24745 T1890 C146 P60975 oass.SolrIndexSearcher.<init> Opening Searcher@66a7ebee realtime
[junit4:junit4] 2> 24745 T1890 C146 P60975 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 24746 T1890 C146 P60975 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 17
[junit4:junit4] 2> 24747 T1932 C144 P60982 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 24747 T1932 C144 P60982 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 24749 T1891 C146 P60975 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 24749 T1891 C146 P60975 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 24750 T1932 C144 P60982 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 24750 T1932 C144 P60982 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 24750 T1932 C144 P60982 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 24753 T1891 C146 P60975 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty2
[junit4:junit4] 2> 24754 T1891 C146 P60975 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty2/index
[junit4:junit4] 2> 24754 T1891 C146 P60975 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=1
[junit4:junit4] 2> 24755 T1932 C144 P60982 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 24756 T1932 C144 P60982 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty4/index.20130212232413961 forceNew:false
[junit4:junit4] 2> 24757 T1932 C144 P60982 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty4
[junit4:junit4] 2> 24757 T1932 C144 P60982 oash.SnapPuller.fetchLatestIndex Starting download to RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty4/index.20130212232413961 lockFactory=org.apache.lucene.store.NativeFSLockFactory@269d5687; maxCacheMB=48.0 maxMergeSizeMB=4.0)) fullCopy=true
[junit4:junit4] 2> 24761 T1891 C146 P60975 REQ /replication {file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 24763 T1932 C144 P60982 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty4/index
[junit4:junit4] 2> 24763 T1932 C144 P60982 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 24764 T1932 C144 P60982 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20130212232413961
[junit4:junit4] 2> 24765 T1932 C144 P60982 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty4
[junit4:junit4] 2> 24766 T1932 C144 P60982 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty4
[junit4:junit4] 2> 24766 T1932 C144 P60982 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty4/index/ new=./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty4/index.20130212232413961
[junit4:junit4] 2> 24770 T1932 C144 P60982 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty4/index.20130212232413961 lockFactory=org.apache.lucene.store.NativeFSLockFactory@269d5687; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 24770 T1932 C144 P60982 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 24772 T1932 C144 P60982 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty4
[junit4:junit4] 2> 24772 T1932 C144 P60982 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 24772 T1932 C144 P60982 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 24772 T1932 C144 P60982 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4] 2> 24773 T1932 C144 P60982 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty4/index.20130212232413961
[junit4:junit4] 2> 24774 T1932 C144 P60982 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty4
[junit4:junit4] 2> 24777 T1932 C144 P60982 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty4/index.20130212232413961 lockFactory=org.apache.lucene.store.NativeFSLockFactory@269d5687; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 24778 T1932 C144 P60982 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 24778 T1932 C144 P60982 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 24778 T1932 C144 P60982 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty4
[junit4:junit4] 2> 24779 T1932 C144 P60982 oass.SolrIndexSearcher.<init> Opening Searcher@152a071d main
[junit4:junit4] 2> 24781 T1931 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@152a071d main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 24782 T1931 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty4/index
[junit4:junit4] 2> 24782 T1932 C144 P60982 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4] 2> 24786 T1932 C144 P60982 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty4/index.20130212232413961 lockFactory=org.apache.lucene.store.NativeFSLockFactory@269d5687; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty4/index.20130212232413961 lockFactory=org.apache.lucene.store.NativeFSLockFactory@269d5687; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> 24786 T1932 C144 P60982 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4] 2> 24787 T1932 C144 P60982 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty4
[junit4:junit4] 2> 24788 T1932 C144 P60982 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 24788 T1932 C144 P60982 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty4/index.20130212232413961
[junit4:junit4] 2> 24788 T1932 C144 P60982 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1360668229211/jetty4/index
[junit4:junit4] 2> 24788 T1932 C144 P60982 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 24788 T1932 C144 P60982 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 24789 T1932 C144 P60982 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 24789 T1932 C144 P60982 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 24791 T1932 C144 P60982 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 25391 T1865 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 25392 T1865 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:60982_hu_%2Fj",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60982/hu_/j"}
[junit4:junit4] 2> 25423 T1898 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 25423 T1864 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 25423 T1929 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 25423 T1913 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 25423 T1870 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 25423 T1883 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 25721 T1842 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 25723 T1842 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C147 name=collection1 org.apache.solr.core.SolrCore@47414e2f url=http://127.0.0.1:60968/hu_/j/collection1 node=127.0.0.1:60968_hu_%2Fj C147_STATE=coll:control_collection core:collection1 props:{shard=shard1, roles=null, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:60968_hu_%2Fj, base_url=http://127.0.0.1:60968/hu_/j, leader=true}
[junit4:junit4] 2> 25742 T1854 C147 P60968 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-
[...truncated too long message...]
.testDistribSearch(BaseDistributedSearchTestCase.java:794)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4] > at java.lang.reflect.Method.invoke(Method.java:601)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] > at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4] > at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] > at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] > at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 3421829 T1842 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> NOTE: test params are: codec=Lucene42: {n_f1=MockVariableIntBlock(baseBlockSize=93), foo_b=MockFixedIntBlock(blockSize=781), cat=PostingsFormat(name=Memory doPackFST= true), foo_d=Pulsing41(freqCutoff=2 minBlockSize=28 maxBlockSize=137), foo_f=MockFixedIntBlock(blockSize=781), n_tl1=MockVariableIntBlock(baseBlockSize=93), n_d1=PostingsFormat(name=Memory doPackFST= true), rnd_b=Pulsing41(freqCutoff=2 minBlockSize=28 maxBlockSize=137), intDefault=PostingsFormat(name=Memory doPackFST= true), n_td1=MockVariableIntBlock(baseBlockSize=93), timestamp=PostingsFormat(name=Memory doPackFST= true), id=Pulsing41(freqCutoff=2 minBlockSize=28 maxBlockSize=137), range_facet_sl=MockFixedIntBlock(blockSize=781), range_facet_si=MockVariableIntBlock(baseBlockSize=93), oddField_s=MockFixedIntBlock(blockSize=781), sequence_i=MockFixedIntBlock(blockSize=781), name=Pulsing41(freqCutoff=2 minBlockSize=28 maxBlockSize=137), foo_i=MockVariableIntBlock(baseBlockSize=93), regex_dup_B_s=PostingsFormat(name=Memory doPackFST= true), multiDefault=MockVariableIntBlock(baseBlockSize=93), n_tf1=PostingsFormat(name=Memory doPackFST= true), n_dt1=MockVariableIntBlock(baseBlockSize=93), genre_s=MockFixedIntBlock(blockSize=781), author_t=MockVariableIntBlock(baseBlockSize=93), n_ti1=Pulsing41(freqCutoff=2 minBlockSize=28 maxBlockSize=137), range_facet_l=PostingsFormat(name=Memory doPackFST= true), text=MockFixedIntBlock(blockSize=781), _version_=PostingsFormat(name=Memory doPackFST= true), val_i=Pulsing41(freqCutoff=2 minBlockSize=28 maxBlockSize=137), SubjectTerms_mfacet=PostingsFormat(name=Memory doPackFST= true), series_t=MockVariableIntBlock(baseBlockSize=93), a_t=PostingsFormat(name=Memory doPackFST= true), n_tdt1=PostingsFormat(name=Memory doPackFST= true), regex_dup_A_s=MockFixedIntBlock(blockSize=781), price=MockFixedIntBlock(blockSize=781), other_tl1=PostingsFormat(name=Memory doPackFST= true), n_l1=PostingsFormat(name=Memory doPackFST= true), a_si=MockVariableIntBlock(baseBlockSize=93), inStock=MockFixedIntBlock(blockSize=781)}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=nl_NL, timezone=Asia/Kamchatka
[junit4:junit4] 2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_09 (64-bit)/cpus=16,threads=1,free=346336384,total=440401920
[junit4:junit4] 2> NOTE: All tests run in this JVM: [TestReload, ShowFileRequestHandlerTest, QueryParsingTest, TestCSVLoader, OutputWriterTest, DOMUtilTest, RAMDirectoryFactoryTest, TestRemoteStreaming, DistributedQueryElevationComponentTest, DebugComponentTest, ClusterStateTest, SuggesterTest, TestReplicationHandler, FileUtilsTest, TestSolrDeletionPolicy1, PolyFieldTest, SolrIndexConfigTest, SolrInfoMBeanTest, TestCSVResponseWriter, TestOmitPositions, XsltUpdateRequestHandlerTest, TestRealTimeGet, TestDistributedSearch, TestSurroundQueryParser, TestBinaryField, TestSolrDeletionPolicy2, TestSolr4Spatial, DirectSolrSpellCheckerTest, DocumentAnalysisRequestHandlerTest, RecoveryZkTest, TestSolrCoreProperties, TestCharFilters, PingRequestHandlerTest, TestDistributedGrouping, TestCodecSupport, TimeZoneUtilsTest, BasicDistributedZk2Test, TestMultiCoreConfBootstrap, TestSort, TestQuerySenderListener, ZkSolrClientTest, SuggesterTSTTest, FullSolrCloudDistribCmdsTest, SolrCoreTest, FieldMutatingUpdateProcessorTest, TestFunctionQuery, TestComponentsName, QueryEqualityTest, TestRecovery, TestZkChroot, TestBM25SimilarityFactory, SynonymTokenizerTest, LeaderElectionTest, PathHierarchyTokenizerFactoryTest, AnalysisAfterCoreReloadTest, IndexReaderFactoryTest, TestDocumentBuilder, BadIndexSchemaTest, TestSolrXMLSerializer, IndexSchemaRuntimeFieldTest, RequiredFieldsTest, TestArbitraryIndexDir, BasicDistributedZkTest]
[junit4:junit4] Completed on J1 in 3422.26s, 1 test, 1 error <<< FAILURES!
[...truncated 10 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:381: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:361: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build.xml:183: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/common-build.xml:447: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/common-build.xml:1202: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/common-build.xml:865: There were test failures: 250 suites, 1040 tests, 1 error, 22 ignored (4 assumptions)
Total time: 93 minutes 9 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-Tests-trunk-java7 - Build # 3727 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-trunk-java7/3727/
2 tests failed.
FAILED: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.testDistribSearch
Error Message:
Test abandoned because suite timeout was reached.
Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
at __randomizedtesting.SeedInfo.seed([C493A87FA26DB8AE]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
Error Message:
Suite timeout exceeded (>= 7200000 msec).
Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
at __randomizedtesting.SeedInfo.seed([C493A87FA26DB8AE]:0)
Build Log:
[...truncated 9538 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
[junit4:junit4] 2> 1 T2820 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4] 2> 8 T2820 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./solrtest-ChaosMonkeySafeLeaderTest-1360635808111
[junit4:junit4] 2> 9 T2820 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 10 T2821 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 13 T2821 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4] 2> 13 T2821 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4] 2> 13 T2821 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4] 2> 14 T2821 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> 15 T2821 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4] 2> 110 T2820 oasc.ZkTestServer.run start zk server on port:34857
[junit4:junit4] 2> 110 T2820 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:34857 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@39194139
[junit4:junit4] 2> 111 T2820 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 112 T2826 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:34857. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 112 T2826 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:34857, initiating session
[junit4:junit4] 2> 113 T2822 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:34858
[junit4:junit4] 2> 113 T2822 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:34858
[junit4:junit4] 2> 114 T2824 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4] 2> 144 T2824 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ccc36c9770000 with negotiated timeout 10000 for client /140.211.11.196:34858
[junit4:junit4] 2> 144 T2826 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:34857, sessionid = 0x13ccc36c9770000, negotiated timeout = 10000
[junit4:junit4] 2> 145 T2827 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@39194139 name:ZooKeeperConnection Watcher:127.0.0.1:34857 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 145 T2820 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 145 T2820 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 148 T2825 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13ccc36c9770000
[junit4:junit4] 2> 157 T2827 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 157 T2822 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:34858 which had sessionid 0x13ccc36c9770000
[junit4:junit4] 2> 157 T2820 oaz.ZooKeeper.close Session: 0x13ccc36c9770000 closed
[junit4:junit4] 2> 158 T2820 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:34857/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@79cca0cf
[junit4:junit4] 2> 159 T2820 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 159 T2828 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:34857. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 160 T2828 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:34857, initiating session
[junit4:junit4] 2> 160 T2822 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:34859
[junit4:junit4] 2> 160 T2822 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:34859
[junit4:junit4] 2> 161 T2824 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ccc36c9770001 with negotiated timeout 10000 for client /140.211.11.196:34859
[junit4:junit4] 2> 162 T2828 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:34857, sessionid = 0x13ccc36c9770001, negotiated timeout = 10000
[junit4:junit4] 2> 162 T2829 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@79cca0cf name:ZooKeeperConnection Watcher:127.0.0.1:34857/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 162 T2820 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 163 T2820 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 173 T2820 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 176 T2820 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 179 T2820 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 186 T2820 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 187 T2820 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 198 T2820 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 199 T2820 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 302 T2820 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 303 T2820 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 306 T2820 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 307 T2820 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 316 T2820 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 317 T2820 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 320 T2820 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 321 T2820 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 324 T2820 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 325 T2820 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 328 T2820 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 328 T2820 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 331 T2820 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 332 T2820 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 339 T2825 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13ccc36c9770001
[junit4:junit4] 2> 340 T2829 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 340 T2820 oaz.ZooKeeper.close Session: 0x13ccc36c9770001 closed
[junit4:junit4] 2> 340 T2822 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:34859 which had sessionid 0x13ccc36c9770001
[junit4:junit4] 2> 524 T2820 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 528 T2820 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:34860
[junit4:junit4] 2> 528 T2820 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 529 T2820 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 529 T2820 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1360635808444
[junit4:junit4] 2> 530 T2820 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1360635808444/solr.xml
[junit4:junit4] 2> 530 T2820 oasc.CoreContainer.<init> New CoreContainer 890112876
[junit4:junit4] 2> 531 T2820 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1360635808444/'
[junit4:junit4] 2> 532 T2820 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1360635808444/'
[junit4:junit4] 2> 595 T2820 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4] 2> 595 T2820 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 596 T2820 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 596 T2820 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 597 T2820 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 597 T2820 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 598 T2820 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 598 T2820 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 599 T2820 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 599 T2820 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4] 2> 622 T2820 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 643 T2820 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:34857/solr
[junit4:junit4] 2> 644 T2820 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 644 T2820 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:34857 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@558dbcca
[junit4:junit4] 2> 645 T2820 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 646 T2839 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:34857. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 647 T2839 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:34857, initiating session
[junit4:junit4] 2> 647 T2822 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:34861
[junit4:junit4] 2> 647 T2822 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:34861
[junit4:junit4] 2> 649 T2824 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ccc36c9770002 with negotiated timeout 20000 for client /140.211.11.196:34861
[junit4:junit4] 2> 649 T2839 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:34857, sessionid = 0x13ccc36c9770002, negotiated timeout = 20000
[junit4:junit4] 2> 649 T2840 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@558dbcca name:ZooKeeperConnection Watcher:127.0.0.1:34857 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 650 T2820 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 651 T2825 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13ccc36c9770002
[junit4:junit4] 2> 652 T2840 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 652 T2822 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:34861 which had sessionid 0x13ccc36c9770002
[junit4:junit4] 2> 652 T2820 oaz.ZooKeeper.close Session: 0x13ccc36c9770002 closed
[junit4:junit4] 2> 653 T2820 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4] 2> 664 T2820 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:34857/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@786b648f
[junit4:junit4] 2> 665 T2820 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 666 T2841 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:34857. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 666 T2841 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:34857, initiating session
[junit4:junit4] 2> 667 T2822 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:34862
[junit4:junit4] 2> 667 T2822 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:34862
[junit4:junit4] 2> 668 T2824 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ccc36c9770003 with negotiated timeout 20000 for client /140.211.11.196:34862
[junit4:junit4] 2> 668 T2841 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:34857, sessionid = 0x13ccc36c9770003, negotiated timeout = 20000
[junit4:junit4] 2> 669 T2842 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@786b648f name:ZooKeeperConnection Watcher:127.0.0.1:34857/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 669 T2820 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 671 T2825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ccc36c9770003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 680 T2820 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 682 T2820 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34860_
[junit4:junit4] 2> 683 T2825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ccc36c9770003 type:delete cxid:0x8 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:34860_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:34860_
[junit4:junit4] 2> 684 T2820 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:34860_
[junit4:junit4] 2> 694 T2820 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 705 T2825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ccc36c9770003 type:delete cxid:0x16 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4] 2> 706 T2820 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 716 T2820 oasc.Overseer.start Overseer (id=89170628320886787-127.0.0.1:34860_-n_0000000000) starting
[junit4:junit4] 2> 717 T2825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ccc36c9770003 type:create cxid:0x1b zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 718 T2825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ccc36c9770003 type:create cxid:0x1c zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 726 T2825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ccc36c9770003 type:create cxid:0x1d zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 727 T2825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ccc36c9770003 type:create cxid:0x1e zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 728 T2844 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 729 T2820 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 743 T2820 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 744 T2843 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 767 T2845 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1360635808444/collection1
[junit4:junit4] 2> 768 T2845 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 768 T2845 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 769 T2845 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 770 T2845 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1360635808444/collection1/'
[junit4:junit4] 2> 771 T2845 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1360635808444/collection1/lib/README' to classloader
[junit4:junit4] 2> 772 T2845 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1360635808444/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 832 T2845 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 909 T2845 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1010 T2845 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 1023 T2845 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 1667 T2845 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 1681 T2845 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1685 T2845 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1697 T2845 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1702 T2845 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1707 T2845 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1708 T2845 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1709 T2845 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1360635808444/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/control/data/
[junit4:junit4] 2> 1709 T2845 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@fed27f0
[junit4:junit4] 2> 1710 T2845 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 1754 T2845 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/control/data forceNew:false
[junit4:junit4] 2> 1755 T2845 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/control/data
[junit4:junit4] 2> 1755 T2845 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/control/data/index/
[junit4:junit4] 2> 1756 T2845 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1758 T2845 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/control/data/index forceNew:false
[junit4:junit4] 2> 1764 T2845 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@5402f759),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 1765 T2845 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 1766 T2845 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/control/data/index
[junit4:junit4] 2> 1766 T2845 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 1768 T2845 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1768 T2845 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 1769 T2845 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1769 T2845 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 1770 T2845 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1770 T2845 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1770 T2845 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1771 T2845 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1772 T2845 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1772 T2845 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 1773 T2845 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 1773 T2845 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1774 T2845 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 1774 T2845 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 1774 T2845 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 1775 T2845 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1775 T2845 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 1776 T2845 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 1776 T2845 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 1777 T2845 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 1777 T2845 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 1778 T2845 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 1778 T2845 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 1779 T2845 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 1780 T2845 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 1780 T2845 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 1797 T2845 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1804 T2845 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 1805 T2845 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4] 2> 1807 T2845 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/control/data
[junit4:junit4] 2> 1810 T2845 oass.SolrIndexSearcher.<init> Opening Searcher@4e181df6 main
[junit4:junit4] 2> 1811 T2845 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1811 T2845 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1812 T2845 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 1820 T2845 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 1879 T2846 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4e181df6 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1884 T2845 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1885 T2845 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1885 T2825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ccc36c9770003 type:create cxid:0x51 zxid:0x29 txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4] 2> 2265 T2843 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 2266 T2843 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "node_name":"127.0.0.1:34860_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:34860"}
[junit4:junit4] 2> 2266 T2843 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 2266 T2843 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 2267 T2825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ccc36c9770003 type:create cxid:0x59 zxid:0x2c txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4] 2> 2281 T2842 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 2889 T2845 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 2889 T2845 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:34860 collection:control_collection shard:shard1
[junit4:junit4] 2> 2890 T2845 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 2934 T2825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ccc36c9770003 type:delete cxid:0x73 zxid:0x36 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4] 2> 2935 T2845 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 2936 T2825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ccc36c9770003 type:create cxid:0x74 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 2938 T2845 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 2938 T2845 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 2938 T2845 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:34860/collection1/
[junit4:junit4] 2> 2939 T2845 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 2939 T2845 oasc.SyncStrategy.syncToMe http://127.0.0.1:34860/collection1/ has no replicas
[junit4:junit4] 2> 2939 T2845 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:34860/collection1/
[junit4:junit4] 2> 2939 T2845 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 2943 T2825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ccc36c9770003 type:create cxid:0x7e zxid:0x3b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3785 T2843 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3800 T2842 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 3811 T2845 oasc.ZkController.register We are http://127.0.0.1:34860/collection1/ and leader is http://127.0.0.1:34860/collection1/
[junit4:junit4] 2> 3811 T2845 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:34860
[junit4:junit4] 2> 3811 T2845 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 3811 T2845 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 3812 T2845 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 3814 T2845 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3815 T2820 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 3815 T2820 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 3816 T2820 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 3830 T2820 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 3840 T2820 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:34857/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@7dcccec3
[junit4:junit4] 2> 3841 T2820 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3841 T2847 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:34857. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 3842 T2847 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:34857, initiating session
[junit4:junit4] 2> 3842 T2822 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:34869
[junit4:junit4] 2> 3842 T2822 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:34869
[junit4:junit4] 2> 3844 T2824 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ccc36c9770004 with negotiated timeout 10000 for client /140.211.11.196:34869
[junit4:junit4] 2> 3844 T2847 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:34857, sessionid = 0x13ccc36c9770004, negotiated timeout = 10000
[junit4:junit4] 2> 3845 T2848 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7dcccec3 name:ZooKeeperConnection Watcher:127.0.0.1:34857/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3845 T2820 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3846 T2820 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 3847 T2820 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 4014 T2820 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 4018 T2820 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:34870
[junit4:junit4] 2> 4019 T2820 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 4019 T2820 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 4020 T2820 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1360635811951
[junit4:junit4] 2> 4020 T2820 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1360635811951/solr.xml
[junit4:junit4] 2> 4021 T2820 oasc.CoreContainer.<init> New CoreContainer 2117905020
[junit4:junit4] 2> 4022 T2820 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1360635811951/'
[junit4:junit4] 2> 4022 T2820 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1360635811951/'
[junit4:junit4] 2> 4083 T2820 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4] 2> 4084 T2820 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 4084 T2820 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 4085 T2820 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 4085 T2820 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 4086 T2820 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 4086 T2820 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 4087 T2820 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 4087 T2820 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 4088 T2820 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4] 2> 4108 T2820 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 4128 T2820 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:34857/solr
[junit4:junit4] 2> 4129 T2820 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 4129 T2820 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:34857 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1c5995d7
[junit4:junit4] 2> 4130 T2820 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 4131 T2858 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:34857. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 4132 T2858 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:34857, initiating session
[junit4:junit4] 2> 4132 T2822 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:34871
[junit4:junit4] 2> 4132 T2822 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:34871
[junit4:junit4] 2> 4134 T2824 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ccc36c9770005 with negotiated timeout 20000 for client /140.211.11.196:34871
[junit4:junit4] 2> 4134 T2858 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:34857, sessionid = 0x13ccc36c9770005, negotiated timeout = 20000
[junit4:junit4] 2> 4135 T2859 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c5995d7 name:ZooKeeperConnection Watcher:127.0.0.1:34857 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 4135 T2820 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 4136 T2825 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13ccc36c9770005
[junit4:junit4] 2> 4137 T2859 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 4137 T2822 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:34871 which had sessionid 0x13ccc36c9770005
[junit4:junit4] 2> 4137 T2820 oaz.ZooKeeper.close Session: 0x13ccc36c9770005 closed
[junit4:junit4] 2> 4138 T2820 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4] 2> 4151 T2820 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:34857/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@1881ec36
[junit4:junit4] 2> 4153 T2820 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 4154 T2860 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:34857. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 4155 T2860 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:34857, initiating session
[junit4:junit4] 2> 4155 T2822 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:34872
[junit4:junit4] 2> 4155 T2822 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:34872
[junit4:junit4] 2> 4205 T2824 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ccc36c9770006 with negotiated timeout 20000 for client /140.211.11.196:34872
[junit4:junit4] 2> 4205 T2860 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:34857, sessionid = 0x13ccc36c9770006, negotiated timeout = 20000
[junit4:junit4] 2> 4206 T2861 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1881ec36 name:ZooKeeperConnection Watcher:127.0.0.1:34857/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 4206 T2820 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 4207 T2825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ccc36c9770006 type:create cxid:0x1 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 4229 T2825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ccc36c9770006 type:create cxid:0x2 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 4230 T2820 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 4232 T2820 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34870_
[junit4:junit4] 2> 4233 T2825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ccc36c9770006 type:delete cxid:0x9 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:34870_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:34870_
[junit4:junit4] 2> 4235 T2820 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:34870_
[junit4:junit4] 2> 4238 T2848 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 4238 T2861 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 4238 T2842 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 4238 T2842 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 4298 T2862 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1360635811951/collection1
[junit4:junit4] 2> 4299 T2862 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 4300 T2862 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 4300 T2862 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 4301 T2862 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1360635811951/collection1/'
[junit4:junit4] 2> 4303 T2862 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1360635811951/collection1/lib/README' to classloader
[junit4:junit4] 2> 4303 T2862 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1360635811951/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 4382 T2862 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 4455 T2862 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 4556 T2862 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 4569 T2862 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 5203 T2862 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 5217 T2862 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 5222 T2862 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 5235 T2862 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 5240 T2862 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 5245 T2862 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 5246 T2862 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 5248 T2862 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1360635811951/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/jetty1/
[junit4:junit4] 2> 5248 T2862 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@fed27f0
[junit4:junit4] 2> 5248 T2862 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 5250 T2862 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/jetty1 forceNew:false
[junit4:junit4] 2> 5250 T2862 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/jetty1
[junit4:junit4] 2> 5251 T2862 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/jetty1/index/
[junit4:junit4] 2> 5251 T2862 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 5253 T2862 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/jetty1/index forceNew:false
[junit4:junit4] 2> 5269 T2862 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@7e0831f8),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 5270 T2862 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 5271 T2862 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/jetty1/index
[junit4:junit4] 2> 5271 T2862 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 5273 T2862 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 5274 T2862 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 5274 T2862 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 5275 T2862 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 5275 T2862 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 5276 T2862 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 5276 T2862 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 5277 T2862 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 5278 T2862 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 5278 T2862 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 5279 T2862 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 5280 T2862 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 5280 T2862 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 5281 T2862 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 5281 T2862 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 5282 T2862 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 5283 T2862 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 5283 T2862 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 5284 T2862 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 5285 T2862 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 5286 T2862 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 5286 T2862 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 5287 T2862 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 5288 T2862 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 5289 T2862 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 5289 T2862 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 5305 T2843 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 5306 T2843 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "node_name":"127.0.0.1:34860_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:34860"}
[junit4:junit4] 2> 5307 T2862 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 5311 T2848 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 5311 T2861 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 5311 T2842 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 5313 T2862 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 5320 T2862 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4] 2> 5323 T2862 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/jetty1
[junit4:junit4] 2> 5325 T2862 oass.SolrIndexSearcher.<init> Opening Searcher@760a06fd main
[junit4:junit4] 2> 5326 T2862 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 5327 T2862 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 5327 T2862 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 5337 T2862 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 5391 T2863 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@760a06fd main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 5399 T2862 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 5399 T2862 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 6822 T2843 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 6823 T2843 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:34870_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:34870"}
[junit4:junit4] 2> 6823 T2843 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 3
[junit4:junit4] 2> 6823 T2843 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 6837 T2848 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6837 T2842 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6837 T2861 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7403 T2862 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 7403 T2862 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:34870 collection:collection1 shard:shard1
[junit4:junit4] 2> 7404 T2862 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 7419 T2825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ccc36c9770006 type:delete cxid:0x47 zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4] 2> 7420 T2862 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 7421 T2825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ccc36c9770006 type:create cxid:0x48 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 7422 T2862 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 7423 T2862 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 7423 T2862 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:34870/collection1/
[junit4:junit4] 2> 7423 T2862 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 7423 T2862 oasc.SyncStrategy.syncToMe http://127.0.0.1:34870/collection1/ has no replicas
[junit4:junit4] 2> 7424 T2862 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:34870/collection1/
[junit4:junit4] 2> 7424 T2862 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 7427 T2825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ccc36c9770006 type:create cxid:0x52 zxid:0x60 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8340 T2843 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 8354 T2861 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8354 T2842 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8354 T2848 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8398 T2862 oasc.ZkController.register We are http://127.0.0.1:34870/collection1/ and leader is http://127.0.0.1:34870/collection1/
[junit4:junit4] 2> 8398 T2862 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:34870
[junit4:junit4] 2> 8398 T2862 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 8398 T2862 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 8399 T2862 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 8400 T2862 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 8401 T2820 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 8402 T2820 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 8402 T2820 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 8586 T2820 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 8590 T2820 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:34877
[junit4:junit4] 2> 8590 T2820 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 8591 T2820 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 8591 T2820 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1360635816519
[junit4:junit4] 2> 8592 T2820 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1360635816519/solr.xml
[junit4:junit4] 2> 8593 T2820 oasc.CoreContainer.<init> New CoreContainer 714999149
[junit4:junit4] 2> 8593 T2820 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1360635816519/'
[junit4:junit4] 2> 8594 T2820 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1360635816519/'
[junit4:junit4] 2> 8658 T2820 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4] 2> 8659 T2820 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 8659 T2820 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 8660 T2820 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 8660 T2820 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 8661 T2820 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 8661 T2820 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 8662 T2820 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 8662 T2820 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 8663 T2820 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4] 2> 8683 T2820 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 8704 T2820 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:34857/solr
[junit4:junit4] 2> 8704 T2820 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 8705 T2820 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:34857 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@635260
[junit4:junit4] 2> 8706 T2820 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 8706 T2873 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:34857. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 8707 T2873 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:34857, initiating session
[junit4:junit4] 2> 8708 T2822 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:34878
[junit4:junit4] 2> 8708 T2822 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:34878
[junit4:junit4] 2> 8710 T2824 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ccc36c9770007 with negotiated timeout 20000 for client /140.211.11.196:34878
[junit4:junit4] 2> 8710 T2873 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:34857, sessionid = 0x13ccc36c9770007, negotiated timeout = 20000
[junit4:junit4] 2> 8710 T2874 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@635260 name:ZooKeeperConnection Watcher:127.0.0.1:34857 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 8710 T2820 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 8711 T2825 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13ccc36c9770007
[junit4:junit4] 2> 8712 T2874 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 8713 T2822 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:34878 which had sessionid 0x13ccc36c9770007
[junit4:junit4] 2> 8712 T2820 oaz.ZooKeeper.close Session: 0x13ccc36c9770007 closed
[junit4:junit4] 2> 8713 T2820 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4] 2> 8723 T2820 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:34857/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@28480011
[junit4:junit4] 2> 8724 T2820 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 8725 T2875 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:34857. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 8725 T2875 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:34857, initiating session
[junit4:junit4] 2> 8726 T2822 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:34879
[junit4:junit4] 2> 8726 T2822 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:34879
[junit4:junit4] 2> 8727 T2824 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ccc36c9770008 with negotiated timeout 20000 for client /140.211.11.196:34879
[junit4:junit4] 2> 8727 T2875 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:34857, sessionid = 0x13ccc36c9770008, negotiated timeout = 20000
[junit4:junit4] 2> 8728 T2876 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@28480011 name:ZooKeeperConnection Watcher:127.0.0.1:34857/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 8728 T2820 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 8729 T2825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ccc36c9770008 type:create cxid:0x1 zxid:0x6d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8731 T2825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ccc36c9770008 type:create cxid:0x2 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8739 T2820 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 8741 T2820 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34877_
[junit4:junit4] 2> 8741 T2825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ccc36c9770008 type:delete cxid:0x9 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:34877_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:34877_
[junit4:junit4] 2> 8742 T2820 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:34877_
[junit4:junit4] 2> 8745 T2861 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8745 T2848 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8745 T2842 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 8745 T2876 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 8745 T2842 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 8746 T2861 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 8754 T2848 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 8761 T2877 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1360635816519/collection1
[junit4:junit4] 2> 8761 T2877 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 8762 T2877 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 8762 T2877 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 8763 T2877 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1360635816519/collection1/'
[junit4:junit4] 2> 8764 T2877 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1360635816519/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 8765 T2877 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1360635816519/collection1/lib/README' to classloader
[junit4:junit4] 2> 8823 T2877 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 8915 T2877 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 9016 T2877 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 9026 T2877 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 9659 T2877 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 9671 T2877 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 9676 T2877 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 9689 T2877 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 9694 T2877 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 9699 T2877 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 9700 T2877 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 9701 T2877 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1360635816519/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/jetty2/
[junit4:junit4] 2> 9701 T2877 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@fed27f0
[junit4:junit4] 2> 9702 T2877 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 9703 T2877 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/jetty2 forceNew:false
[junit4:junit4] 2> 9704 T2877 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/jetty2
[junit4:junit4] 2> 9704 T2877 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/jetty2/index/
[junit4:junit4] 2> 9705 T2877 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 9706 T2877 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/jetty2/index forceNew:false
[junit4:junit4] 2> 9723 T2877 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@19af58cc),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 9723 T2877 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 9724 T2877 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/jetty2/index
[junit4:junit4] 2> 9724 T2877 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 9726 T2877 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 9727 T2877 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 9727 T2877 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 9728 T2877 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 9728 T2877 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 9729 T2877 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 9729 T2877 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 9730 T2877 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 9731 T2877 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 9731 T2877 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 9732 T2877 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 9733 T2877 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 9733 T2877 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 9734 T2877 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 9734 T2877 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 9735 T2877 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 9736 T2877 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 9736 T2877 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 9737 T2877 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 9738 T2877 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 9739 T2877 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 9739 T2877 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 9740 T2877 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 9741 T2877 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 9742 T2877 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 9742 T2877 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 9757 T2877 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 9762 T2877 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 9763 T2877 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4] 2> 9766 T2877 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/jetty2
[junit4:junit4] 2> 9768 T2877 oass.SolrIndexSearcher.<init> Opening Searcher@1d96ec7 main
[junit4:junit4] 2> 9769 T2877 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 9769 T2877 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 9770 T2877 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 9778 T2877 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 9840 T2878 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1d96ec7 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 9848 T2877 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 9849 T2877 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 9865 T2843 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 9866 T2843 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:34870_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:34870"}
[junit4:junit4] 2> 9869 T2843 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:34877_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:34877"}
[junit4:junit4] 2> 9870 T2843 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4:junit4] 2> 9870 T2843 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4] 2> 9885 T2876 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9885 T2861 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9885 T2842 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9885 T2848 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 10852 T2877 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 10852 T2877 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:34877 collection:collection1 shard:shard2
[junit4:junit4] 2> 10853 T2877 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 10898 T2825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ccc36c9770008 type:delete cxid:0x44 zxid:0x7d txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard2 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard2
[junit4:junit4] 2> 10899 T2877 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 10899 T2825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ccc36c9770008 type:create cxid:0x45 zxid:0x7e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 10910 T2877 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 10910 T2877 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 10911 T2877 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:34877/collection1/
[junit4:junit4] 2> 10911 T2877 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 10911 T2877 oasc.SyncStrategy.syncToMe http://127.0.0.1:34877/collection1/ has no replicas
[junit4:junit4] 2> 10912 T2877 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:34877/collection1/
[junit4:junit4] 2> 10912 T2877 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 10915 T2825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ccc36c9770008 type:create cxid:0x4e zxid:0x81 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 11391 T2843 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 11407 T2842 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11407 T2848 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11407 T2861 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11407 T2876 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11433 T2877 oasc.ZkController.register We are http://127.0.0.1:34877/collection1/ and leader is http://127.0.0.1:34877/collection1/
[junit4:junit4] 2> 11433 T2877 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:34877
[junit4:junit4] 2> 11433 T2877 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 11433 T2877 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 11434 T2877 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 11435 T2877 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 11436 T2820 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 11437 T2820 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 11437 T2820 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 11606 T2820 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 11610 T2820 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:34883
[junit4:junit4] 2> 11611 T2820 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 11611 T2820 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 11612 T2820 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1360635819553
[junit4:junit4] 2> 11612 T2820 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1360635819553/solr.xml
[junit4:junit4] 2> 11613 T2820 oasc.CoreContainer.<init> New CoreContainer 1174781027
[junit4:junit4] 2> 11614 T2820 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1360635819553/'
[junit4:junit4] 2> 11614 T2820 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1360635819553/'
[junit4:junit4] 2> 11671 T2820 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4] 2> 11672 T2820 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 11672 T2820 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 11673 T2820 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 11673 T2820 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 11673 T2820 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 11674 T2820 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 11674 T2820 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 11675 T2820 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 11675 T2820 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4] 2> 11694 T2820 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 11712 T2820 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:34857/solr
[junit4:junit4] 2> 11713 T2820 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 11713 T2820 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:34857 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@d34a476
[junit4:junit4] 2> 11714 T2820 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 11715 T2888 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:34857. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 11716 T2888 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:34857, initiating session
[junit4:junit4] 2> 11716 T2822 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:34884
[junit4:junit4] 2> 11717 T2822 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:34884
[junit4:junit4] 2> 11719 T2824 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ccc36c9770009 with negotiated timeout 20000 for client /140.211.11.196:34884
[junit4:junit4] 2> 11719 T2888 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:34857, sessionid = 0x13ccc36c9770009, negotiated timeout = 20000
[junit4:junit4] 2> 11719 T2889 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d34a476 name:ZooKeeperConnection Watcher:127.0.0.1:34857 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 11719 T2820 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 11720 T2825 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13ccc36c9770009
[junit4:junit4] 2> 11733 T2889 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 11733 T2822 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:34884 which had sessionid 0x13ccc36c9770009
[junit4:junit4] 2> 11733 T2820 oaz.ZooKeeper.close Session: 0x13ccc36c9770009 closed
[junit4:junit4] 2> 11733 T2820 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4] 2> 11743 T2820 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:34857/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@561c31cf
[junit4:junit4] 2> 11744 T2820 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 11744 T2890 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:34857. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 11744 T2890 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:34857, initiating session
[junit4:junit4] 2> 11745 T2822 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:34885
[junit4:junit4] 2> 11745 T2822 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:34885
[junit4:junit4] 2> 11746 T2824 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ccc36c977000a with negotiated timeout 20000 for client /140.211.11.196:34885
[junit4:junit4] 2> 11746 T2890 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:34857, sessionid = 0x13ccc36c977000a, negotiated timeout = 20000
[junit4:junit4] 2> 11747 T2891 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@561c31cf name:ZooKeeperConnection Watcher:127.0.0.1:34857/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 11747 T2820 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 11748 T2825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ccc36c977000a type:create cxid:0x1 zxid:0x8e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 11749 T2825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ccc36c977000a type:create cxid:0x2 zxid:0x8f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 11751 T2820 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 11753 T2820 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34883_
[junit4:junit4] 2> 11753 T2825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ccc36c977000a type:delete cxid:0x9 zxid:0x90 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:34883_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:34883_
[junit4:junit4] 2> 11759 T2820 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:34883_
[junit4:junit4] 2> 11761 T2876 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11761 T2861 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11761 T2848 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11762 T2842 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 11762 T2891 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 11762 T2842 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 11763 T2848 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 11763 T2861 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 11764 T2876 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 11769 T2892 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1360635819553/collection1
[junit4:junit4] 2> 11770 T2892 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 11770 T2892 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 11770 T2892 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 11772 T2892 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1360635819553/collection1/'
[junit4:junit4] 2> 11773 T2892 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1360635819553/collection1/lib/README' to classloader
[junit4:junit4] 2> 11773 T2892 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1360635819553/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 11830 T2892 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 11923 T2892 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 12024 T2892 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 12034 T2892 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 12657 T2892 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 12669 T2892 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 12673 T2892 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 12686 T2892 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 12691 T2892 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 12696 T2892 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 12697 T2892 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 12698 T2892 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1360635819553/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/jetty3/
[junit4:junit4] 2> 12698 T2892 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@fed27f0
[junit4:junit4] 2> 12699 T2892 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 12700 T2892 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/jetty3 forceNew:false
[junit4:junit4] 2> 12701 T2892 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/jetty3
[junit4:junit4] 2> 12701 T2892 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/jetty3/index/
[junit4:junit4] 2> 12702 T2892 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 12703 T2892 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/jetty3/index forceNew:false
[junit4:junit4] 2> 12714 T2892 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1f9e5f90),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 12715 T2892 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 12716 T2892 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/jetty3/index
[junit4:junit4] 2> 12717 T2892 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 12720 T2892 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 12721 T2892 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 12721 T2892 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 12722 T2892 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 12723 T2892 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 12723 T2892 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 12724 T2892 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 12725 T2892 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 12726 T2892 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 12727 T2892 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 12728 T2892 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 12728 T2892 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 12729 T2892 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 12730 T2892 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 12730 T2892 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 12731 T2892 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 12732 T2892 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 12733 T2892 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 12734 T2892 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 12734 T2892 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 12735 T2892 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 12736 T2892 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 12737 T2892 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 12738 T2892 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 12739 T2892 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 12740 T2892 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 12761 T2892 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 12769 T2892 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 12770 T2892 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4] 2> 12774 T2892 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/jetty3
[junit4:junit4] 2> 12777 T2892 oass.SolrIndexSearcher.<init> Opening Searcher@4211e71d main
[junit4:junit4] 2> 12778 T2892 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 12779 T2892 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 12780 T2892 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 12801 T2892 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 12857 T2893 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4211e71d main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 12865 T2892 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 12866 T2892 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 12912 T2843 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 12913 T2843 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:34877_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:34877"}
[junit4:junit4] 2> 12916 T2843 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:34883_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:34883"}
[junit4:junit4] 2> 12916 T2843 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4:junit4] 2> 12916 T2843 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
[junit4:junit4] 2> 12928 T2861 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 12928 T2876 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 12928 T2842 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 12928 T2848 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 12928 T2891 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13868 T2892 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 13868 T2892 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:34883 collection:collection1 shard:shard3
[junit4:junit4] 2> 13869 T2892 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
[junit4:junit4] 2> 13901 T2825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ccc36c977000a type:delete cxid:0x44 zxid:0x9e txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard3 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard3
[junit4:junit4] 2> 13912 T2892 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 13913 T2825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ccc36c977000a type:create cxid:0x45 zxid:0x9f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 13915 T2892 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 13915 T2892 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 13915 T2892 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:34883/collection1/
[junit4:junit4] 2> 13916 T2892 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 13916 T2892 oasc.SyncStrategy.syncToMe http://127.0.0.1:34883/collection1/ has no replicas
[junit4:junit4] 2> 13916 T2892 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:34883/collection1/
[junit4:junit4] 2> 13916 T2892 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3
[junit4:junit4] 2> 13919 T2825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ccc36c977000a type:create cxid:0x4e zxid:0xa2 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 14439 T2843 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 14465 T2842 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14465 T2876 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14465 T2848 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14465 T2861 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14465 T2891 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14488 T2892 oasc.ZkController.register We are http://127.0.0.1:34883/collection1/ and leader is http://127.0.0.1:34883/collection1/
[junit4:junit4] 2> 14488 T2892 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:34883
[junit4:junit4] 2> 14488 T2892 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 14488 T2892 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 14489 T2892 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 14490 T2892 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 14491 T2820 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 14492 T2820 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 14492 T2820 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 14674 T2820 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 14678 T2820 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:34889
[junit4:junit4] 2> 14679 T2820 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 14679 T2820 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 14680 T2820 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1360635822609
[junit4:junit4] 2> 14680 T2820 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1360635822609/solr.xml
[junit4:junit4] 2> 14681 T2820 oasc.CoreContainer.<init> New CoreContainer 738624780
[junit4:junit4] 2> 14682 T2820 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1360635822609/'
[junit4:junit4] 2> 14682 T2820 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1360635822609/'
[junit4:junit4] 2> 14743 T2820 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4] 2> 14744 T2820 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 14744 T2820 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 14745 T2820 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 14745 T2820 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 14746 T2820 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 14746 T2820 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 14747 T2820 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 14747 T2820 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 14748 T2820 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4] 2> 14768 T2820 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 14787 T2820 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:34857/solr
[junit4:junit4] 2> 14788 T2820 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 14789 T2820 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:34857 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@c5da503
[junit4:junit4] 2> 14790 T2820 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 14790 T2903 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:34857. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 14791 T2903 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:34857, initiating session
[junit4:junit4] 2> 14792 T2822 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:34890
[junit4:junit4] 2> 14792 T2822 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:34890
[junit4:junit4] 2> 14795 T2824 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ccc36c977000b with negotiated timeout 20000 for client /140.211.11.196:34890
[junit4:junit4] 2> 14795 T2903 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:34857, sessionid = 0x13ccc36c977000b, negotiated timeout = 20000
[junit4:junit4] 2> 14796 T2904 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@c5da503 name:ZooKeeperConnection Watcher:127.0.0.1:34857 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 14796 T2820 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 14797 T2825 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13ccc36c977000b
[junit4:junit4] 2> 14814 T2904 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 14814 T2822 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:34890 which had sessionid 0x13ccc36c977000b
[junit4:junit4] 2> 14814 T2820 oaz.ZooKeeper.close Session: 0x13ccc36c977000b closed
[junit4:junit4] 2> 14815 T2820 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4] 2> 14825 T2820 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:34857/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@3793c9c9
[junit4:junit4] 2> 14826 T2905 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:34857. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 14826 T2820 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 14827 T2905 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:34857, initiating session
[junit4:junit4] 2> 14827 T2822 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:34891
[junit4:junit4] 2> 14827 T2822 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:34891
[junit4:junit4] 2> 14829 T2824 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ccc36c977000c with negotiated timeout 20000 for client /140.211.11.196:34891
[junit4:junit4] 2> 14829 T2905 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:34857, sessionid = 0x13ccc36c977000c, negotiated timeout = 20000
[junit4:junit4] 2> 14829 T2906 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3793c9c9 name:ZooKeeperConnection Watcher:127.0.0.1:34857/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 14829 T2820 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 14830 T2825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ccc36c977000c type:create cxid:0x1 zxid:0xaf txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 14832 T2825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ccc36c977000c type:create cxid:0x2 zxid:0xb0 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 14839 T2820 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 14841 T2820 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34889_
[junit4:junit4] 2> 14841 T2825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ccc36c977000c type:delete cxid:0x9 zxid:0xb1 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:34889_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:34889_
[junit4:junit4] 2> 14842 T2820 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:34889_
[junit4:junit4] 2> 14845 T2876 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14845 T2891 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14845 T2848 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14845 T2861 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14846 T2842 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 14845 T2906 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 14846 T2842 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 14847 T2891 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 14847 T2876 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 14848 T2848 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 14848 T2861 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 14854 T2907 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1360635822609/collection1
[junit4:junit4] 2> 14854 T2907 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 14855 T2907 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 14855 T2907 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 14856 T2907 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1360635822609/collection1/'
[junit4:junit4] 2> 14857 T2907 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1360635822609/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 14858 T2907 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1360635822609/collection1/lib/README' to classloader
[junit4:junit4] 2> 14910 T2907 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 14980 T2907 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 15081 T2907 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 15108 T2907 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 15769 T2907 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 15782 T2907 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 15787 T2907 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 15800 T2907 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 15806 T2907 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 15820 T2907 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 15821 T2907 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 15823 T2907 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1360635822609/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/jetty4/
[junit4:junit4] 2> 15823 T2907 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@fed27f0
[junit4:junit4] 2> 15824 T2907 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 15825 T2907 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/jetty4 forceNew:false
[junit4:junit4] 2> 15826 T2907 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/jetty4
[junit4:junit4] 2> 15827 T2907 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/jetty4/index/
[junit4:junit4] 2> 15827 T2907 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 15829 T2907 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/jetty4/index forceNew:false
[junit4:junit4] 2> 15835 T2907 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3eb759dc),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 15835 T2907 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 15836 T2907 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/jetty4/index
[junit4:junit4] 2> 15836 T2907 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 15838 T2907 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 15839 T2907 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 15839 T2907 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 15839 T2907 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 15840 T2907 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 15840 T2907 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 15841 T2907 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 15841 T2907 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 15842 T2907 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 15843 T2907 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 15843 T2907 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 15844 T2907 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 15844 T2907 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 15845 T2907 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 15845 T2907 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 15846 T2907 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 15846 T2907 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 15847 T2907 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 15847 T2907 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 15848 T2907 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 15848 T2907 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 15849 T2907 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 15849 T2907 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 15850 T2907 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 15851 T2907 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 15851 T2907 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 15864 T2907 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 15869 T2907 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 15870 T2907 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4] 2> 15873 T2907 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/jetty4
[junit4:junit4] 2> 15875 T2907 oass.SolrIndexSearcher.<init> Opening Searcher@3afaf246 main
[junit4:junit4] 2> 15876 T2907 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 15876 T2907 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 15877 T2907 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 15893 T2907 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 15948 T2908 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3afaf246 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 15953 T2907 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 15953 T2907 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 15971 T2843 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 15972 T2843 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":"shard3",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:34883_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:34883"}
[junit4:junit4] 2> 15976 T2843 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:34889_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:34889"}
[junit4:junit4] 2> 15976 T2843 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4:junit4] 2> 15976 T2843 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 15988 T2842 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 15988 T2848 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 15988 T2861 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 15988 T2891 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 15988 T2906 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 15988 T2876 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16956 T2907 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 16956 T2907 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:34889 collection:collection1 shard:shard1
[junit4:junit4] 2> 16959 T2907 oasc.ZkController.register We are http://127.0.0.1:34889/collection1/ and leader is http://127.0.0.1:34870/collection1/
[junit4:junit4] 2> 16959 T2907 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:34889
[junit4:junit4] 2> 16959 T2907 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 16959 T2907 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C163 name=collection1 org.apache.solr.core.SolrCore@2d82049c url=http://127.0.0.1:34889/collection1 node=127.0.0.1:34889_ C163_STATE=coll:collection1 core:collection1 props:{shard=null, roles=null, state=down, core=collection1, collection=collection1, node_name=127.0.0.1:34889_, base_url=http://127.0.0.1:34889}
[junit4:junit4] 2> 16960 T2909 C163 P34889 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 16961 T2907 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 17209 T2909 C163 P34889 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 17209 T2909 C163 P34889 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 17209 T2909 C163 P34889 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 17210 T2820 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 17210 T2820 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 17211 T2820 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 17212 T2909 C163 P34889 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 17337 T2820 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 17340 T2820 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:34897
[junit4:junit4] 2> 17340 T2820 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 17341 T2820 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 17341 T2820 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1360635825326
[junit4:junit4] 2> 17341 T2820 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1360635825326/solr.xml
[junit4:junit4] 2> 17342 T2820 oasc.CoreContainer.<init> New CoreContainer 1599205969
[junit4:junit4] 2> 17342 T2820 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1360635825326/'
[junit4:junit4] 2> 17343 T2820 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1360635825326/'
[junit4:junit4] 2> 17384 T2820 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4] 2> 17384 T2820 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 17384 T2820 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 17385 T2820 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 17385 T2820 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 17385 T2820 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 17386 T2820 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 17386 T2820 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 17386 T2820 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 17387 T2820 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4] 2> 17400 T2820 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 17414 T2820 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:34857/solr
[junit4:junit4] 2> 17415 T2820 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 17415 T2820 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:34857 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@2b6f822a
[junit4:junit4] 2> 17416 T2820 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 17416 T2919 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:34857. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 17417 T2919 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:34857, initiating session
[junit4:junit4] 2> 17418 T2822 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:34898
[junit4:junit4] 2> 17418 T2822 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:34898
[junit4:junit4] 2> 17420 T2824 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ccc36c977000d with negotiated timeout 20000 for client /140.211.11.196:34898
[junit4:junit4] 2> 17420 T2919 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:34857, sessionid = 0x13ccc36c977000d, negotiated timeout = 20000
[junit4:junit4] 2> 17420 T2920 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2b6f822a name:ZooKeeperConnection Watcher:127.0.0.1:34857 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 17421 T2820 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 17421 T2825 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13ccc36c977000d
[junit4:junit4] 2> 17430 T2920 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 17430 T2822 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:34898 which had sessionid 0x13ccc36c977000d
[junit4:junit4] 2> 17430 T2820 oaz.ZooKeeper.close Session: 0x13ccc36c977000d closed
[junit4:junit4] 2> 17430 T2820 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4] 2> 17440 T2820 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:34857/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@49c293b6
[junit4:junit4] 2> 17442 T2921 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:34857. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 17442 T2820 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 17442 T2921 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:34857, initiating session
[junit4:junit4] 2> 17442 T2822 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:34899
[junit4:junit4] 2> 17443 T2822 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:34899
[junit4:junit4] 2> 17444 T2824 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ccc36c977000e with negotiated timeout 20000 for client /140.211.11.196:34899
[junit4:junit4] 2> 17444 T2921 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:34857, sessionid = 0x13ccc36c977000e, negotiated timeout = 20000
[junit4:junit4] 2> 17445 T2922 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@49c293b6 name:ZooKeeperConnection Watcher:127.0.0.1:34857/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 17445 T2820 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 17446 T2825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ccc36c977000e type:create cxid:0x1 zxid:0xc1 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 17447 T2825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ccc36c977000e type:create cxid:0x2 zxid:0xc2 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 17448 T2820 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 17450 T2820 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34897_
[junit4:junit4] 2> 17451 T2825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ccc36c977000e type:delete cxid:0x9 zxid:0xc3 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:34897_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:34897_
[junit4:junit4] 2> 17456 T2820 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:34897_
[junit4:junit4] 2> 17459 T2906 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17459 T2891 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17459 T2848 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17459 T2861 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17459 T2876 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17460 T2842 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 17460 T2922 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 17460 T2842 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 17461 T2906 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 17462 T2891 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 17462 T2848 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 17462 T2861 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 17462 T2876 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 17466 T2923 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1360635825326/collection1
[junit4:junit4] 2> 17466 T2923 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 17467 T2923 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 17467 T2923 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 17468 T2923 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1360635825326/collection1/'
[junit4:junit4] 2> 17469 T2923 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1360635825326/collection1/lib/README' to classloader
[junit4:junit4] 2> 17470 T2923 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1360635825326/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 17501 T2843 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 17502 T2843 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:34889_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:34889"}
[junit4:junit4] 2> 17514 T2922 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 17514 T2848 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 17514 T2876 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 17514 T2861 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 17514 T2842 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 17514 T2906 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 17514 T2891 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 17527 T2923 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 17601 T2923 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 17702 T2923 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 17710 T2923 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 18389 T2923 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 18402 T2923 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 18407 T2923 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 18422 T2923 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 18427 T2923 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 18432 T2923 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 18433 T2923 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 18434 T2923 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1360635825326/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/jetty5/
[junit4:junit4] 2> 18434 T2923 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@fed27f0
[junit4:junit4] 2> 18435 T2923 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 18436 T2923 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/jetty5 forceNew:false
[junit4:junit4] 2> 18437 T2923 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/jetty5
[junit4:junit4] 2> 18437 T2923 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/jetty5/index/
[junit4:junit4] 2> 18437 T2923 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/jetty5/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 18439 T2923 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/jetty5/index forceNew:false
[junit4:junit4] 2> 18446 T2923 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/jetty5/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6ec88130),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 18446 T2923 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 18448 T2923 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/jetty5/index
[junit4:junit4] 2> 18448 T2923 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 18450 T2923 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 18451 T2923 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 18451 T2923 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 18451 T2923 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 18452 T2923 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 18452 T2923 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 18453 T2923 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 18454 T2923 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 18454 T2923 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 18455 T2923 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 18456 T2923 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 18456 T2923 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 18457 T2923 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 18457 T2923 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 18457 T2923 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 18458 T2923 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 18458 T2923 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 18459 T2923 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 18460 T2923 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 18460 T2923 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 18461 T2923 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 18461 T2923 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 18462 T2923 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 18462 T2923 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 18463 T2923 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 18464 T2923 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 18478 T2923 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 18484 T2923 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 18486 T2923 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4] 2> 18489 T2923 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/jetty5
[junit4:junit4] 2> 18491 T2923 oass.SolrIndexSearcher.<init> Opening Searcher@5b075ac3 main
[junit4:junit4] 2> 18492 T2923 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 18492 T2923 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 18492 T2923 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 18500 T2923 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 18559 T2924 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5b075ac3 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 18564 T2923 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 18564 T2923 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 19018 T2843 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 19019 T2843 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:34897_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:34897"}
[junit4:junit4] 2> 19019 T2843 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4:junit4] 2> 19019 T2843 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4] 2> 19032 T2891 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 19032 T2861 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 19032 T2848 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 19032 T2906 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 19032 T2842 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 19032 T2922 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 19032 T2876 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 19567 T2923 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 19567 T2923 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:34897 collection:collection1 shard:shard2
[junit4:junit4] 2> 19579 T2923 oasc.ZkController.register We are http://127.0.0.1:34897/collection1/ and leader is http://127.0.0.1:34877/collection1/
[junit4:junit4] 2> 19580 T2923 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:34897
[junit4:junit4] 2> 19580 T2923 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 19580 T2923 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C164 name=collection1 org.apache.solr.core.SolrCore@6c7ed688 url=http://127.0.0.1:34897/collection1 node=127.0.0.1:34897_ C164_STATE=coll:collection1 core:collection1 props:{shard=null, roles=null, state=down, core=collection1, collection=collection1, node_name=127.0.0.1:34897_, base_url=http://127.0.0.1:34897}
[junit4:junit4] 2> 19582 T2925 C164 P34897 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 19582 T2923 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 19600 T2925 C164 P34897 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 19600 T2925 C164 P34897 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 19601 T2925 C164 P34897 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 19601 T2820 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 19601 T2820 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 19602 T2925 C164 P34897 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 19602 T2820 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 19793 T2820 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 19797 T2820 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:34912
[junit4:junit4] 2> 19798 T2820 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 19798 T2820 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 19799 T2820 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1360635827728
[junit4:junit4] 2> 19799 T2820 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1360635827728/solr.xml
[junit4:junit4] 2> 19800 T2820 oasc.CoreContainer.<init> New CoreContainer 569748877
[junit4:junit4] 2> 19801 T2820 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1360635827728/'
[junit4:junit4] 2> 19801 T2820 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1360635827728/'
[junit4:junit4] 2> 19862 T2820 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4] 2> 19863 T2820 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 19864 T2820 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 19865 T2820 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 19865 T2820 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 19866 T2820 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 19867 T2820 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 19868 T2820 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 19868 T2820 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 19869 T2820 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4] 2> 19905 T2820 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 19936 T2820 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:34857/solr
[junit4:junit4] 2> 19937 T2820 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 19938 T2820 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:34857 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@7970404d
[junit4:junit4] 2> 19940 T2935 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:34857. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 19940 T2820 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 19941 T2935 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:34857, initiating session
[junit4:junit4] 2> 19941 T2822 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:34913
[junit4:junit4] 2> 19942 T2822 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:34913
[junit4:junit4] 2> 19944 T2824 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ccc36c977000f with negotiated timeout 20000 for client /140.211.11.196:34913
[junit4:junit4] 2> 19944 T2935 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:34857, sessionid = 0x13ccc36c977000f, negotiated timeout = 20000
[junit4:junit4] 2> 19945 T2936 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7970404d name:ZooKeeperConnection Watcher:127.0.0.1:34857 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 19945 T2820 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 19946 T2825 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13ccc36c977000f
[junit4:junit4] 2> 19963 T2936 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 19963 T2822 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:34913 which had sessionid 0x13ccc36c977000f
[junit4:junit4] 2> 19963 T2820 oaz.ZooKeeper.close Session: 0x13ccc36c977000f closed
[junit4:junit4] 2> 19964 T2820 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4] 2> 19983 T2820 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:34857/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@33044e66
[junit4:junit4] 2> 19985 T2937 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:34857. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 19985 T2820 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 19986 T2937 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:34857, initiating session
[junit4:junit4] 2> 19986 T2822 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:34914
[junit4:junit4] 2> 19987 T2822 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:34914
[junit4:junit4] 2> 19988 T2824 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ccc36c9770010 with negotiated timeout 20000 for client /140.211.11.196:34914
[junit4:junit4] 2> 19988 T2937 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:34857, sessionid = 0x13ccc36c9770010, negotiated timeout = 20000
[junit4:junit4] 2> 19988 T2938 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@33044e66 name:ZooKeeperConnection Watcher:127.0.0.1:34857/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 19989 T2820 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 19990 T2825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ccc36c9770010 type:create cxid:0x1 zxid:0xd4 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 19991 T2825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ccc36c9770010 type:create cxid:0x2 zxid:0xd5 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 20000 T2820 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 20002 T2820 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34912_
[junit4:junit4] 2> 20003 T2825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ccc36c9770010 type:delete cxid:0x9 zxid:0xd6 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:34912_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:34912_
[junit4:junit4] 2> 20004 T2820 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:34912_
[junit4:junit4] 2> 20011 T2906 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 20011 T2848 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 20012 T2938 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 20011 T2842 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 20011 T2876 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 20011 T2861 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 20011 T2922 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 20011 T2891 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 20013 T2842 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 20013 T2906 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 20014 T2848 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 20014 T2876 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 20015 T2861 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 20015 T2891 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 20015 T2922 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 20020 T2939 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1360635827728/collection1
[junit4:junit4] 2> 20021 T2939 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 20021 T2939 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 20022 T2939 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 20023 T2939 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1360635827728/collection1/'
[junit4:junit4] 2> 20024 T2939 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1360635827728/collection1/lib/README' to classloader
[junit4:junit4] 2> 20025 T2939 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1360635827728/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 20083 T2939 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 20158 T2939 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> C163_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:34889_, base_url=http://127.0.0.1:34889}
[junit4:junit4] 2> 20228 T2909 C163 P34889 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:34870/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 20228 T2909 C163 P34889 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:34889 START replicas=[http://127.0.0.1:34870/collection1/] nUpdates=100
[junit4:junit4] 2> 20229 T2909 C163 P34889 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 20230 T2909 C163 P34889 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 20230 T2909 C163 P34889 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 20230 T2909 C163 P34889 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 20231 T2909 C163 P34889 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 20231 T2909 C163 P34889 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:34870/collection1/. core=collection1
[junit4:junit4] 2> 20231 T2909 C163 P34889 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C165 name=collection1 org.apache.solr.core.SolrCore@68737553 url=http://127.0.0.1:34870/collection1 node=127.0.0.1:34870_ C165_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:34870_, base_url=http://127.0.0.1:34870, leader=true}
[junit4:junit4] 2> 20238 T2852 C165 P34870 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 20244 T2853 C165 P34870 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4] 2> 20246 T2853 C165 P34870 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/jetty1
[junit4:junit4] 2> 20250 T2853 C165 P34870 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@7e0831f8),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 20251 T2853 C165 P34870 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 20254 T2853 C165 P34870 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@7e0831f8),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@7e0831f8),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 20255 T2853 C165 P34870 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 20256 T2853 C165 P34870 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360635808111/jetty1
[junit4:junit4] 2> 20256 T2853 C165 P34870 oass.SolrIndexSearcher.<init> Opening Searcher@53597f6b realtime
[junit4:junit4] 2> 20257 T2853 C165 P34870 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 20257 T2853 C165 P34870 /update {waitSearcher=true&openSearcher=false&commit=true&wt=java
[...truncated too long message...]
junit4:junit4] 2> 27) Thread[id=2879, name=HashSessionScavenger-62, state=TIMED_WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4:junit4] 2> at java.lang.Object.wait(Native Method)
[junit4:junit4] 2> at java.util.TimerThread.mainLoop(Timer.java:552)
[junit4:junit4] 2> at java.util.TimerThread.run(Timer.java:505)
[junit4:junit4] 2> 28) Thread[id=2890, name=TEST-ChaosMonkeySafeLeaderTest.testDistribSearch-seed#[C493A87FA26DB8AE]-SendThread(localhost:34857), state=RUNNABLE, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4:junit4] 2> at sun.nio.ch.KQueueArrayWrapper.interrupt(Native Method)
[junit4:junit4] 2> at sun.nio.ch.KQueueArrayWrapper.interrupt(KQueueArrayWrapper.java:164)
[junit4:junit4] 2> at sun.nio.ch.KQueueSelectorImpl.wakeup(KQueueSelectorImpl.java:245)
[junit4:junit4] 2> at java.nio.channels.spi.AbstractSelector$1.interrupt(AbstractSelector.java:210)
[junit4:junit4] 2> at java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:216)
[junit4:junit4] 2> at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:102)
[junit4:junit4] 2> at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
[junit4:junit4] 2> at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4] 2> 29) Thread[id=3188, name=HashSessionScavenger-76, state=TIMED_WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4:junit4] 2> at java.lang.Object.wait(Native Method)
[junit4:junit4] 2> at java.util.TimerThread.mainLoop(Timer.java:552)
[junit4:junit4] 2> at java.util.TimerThread.run(Timer.java:505)
[junit4:junit4] 2> 30) Thread[id=3294, name=TEST-ChaosMonkeySafeLeaderTest.testDistribSearch-seed#[C493A87FA26DB8AE]-SendThread(localhost:34857), state=RUNNABLE, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4:junit4] 2> at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
[junit4:junit4] 2> at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
[junit4:junit4] 2> at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
[junit4:junit4] 2> at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
[junit4:junit4] 2> at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4] 2> 31) Thread[id=3204, name=searcherExecutor-1550-thread-1, state=WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4:junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4:junit4] 2> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4:junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4:junit4] 2> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 32) Thread[id=3266, name=Thread-1199-SendThread(localhost:34857), state=RUNNABLE, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4:junit4] 2> at sun.nio.ch.KQueueArrayWrapper.interrupt(Native Method)
[junit4:junit4] 2> at sun.nio.ch.KQueueArrayWrapper.interrupt(KQueueArrayWrapper.java:164)
[junit4:junit4] 2> at sun.nio.ch.KQueueSelectorImpl.wakeup(KQueueSelectorImpl.java:245)
[junit4:junit4] 2> at java.nio.channels.spi.AbstractSelector$1.interrupt(AbstractSelector.java:210)
[junit4:junit4] 2> at java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:216)
[junit4:junit4] 2> at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:102)
[junit4:junit4] 2> at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
[junit4:junit4] 2> at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4] 2> NOTE: test params are: codec=Lucene42: {range_facet_l=PostingsFormat(name=MockRandom), text=Lucene41(blocksize=128), _version_=PostingsFormat(name=MockRandom), rnd_b=Pulsing41(freqCutoff=11 minBlockSize=43 maxBlockSize=140), intDefault=PostingsFormat(name=MockRandom), timestamp=PostingsFormat(name=MockRandom), id=Pulsing41(freqCutoff=11 minBlockSize=43 maxBlockSize=140), a_t=PostingsFormat(name=MockRandom), range_facet_sl=Lucene41(blocksize=128), range_facet_si=PostingsFormat(name=NestedPulsing), other_tl1=PostingsFormat(name=MockRandom), multiDefault=PostingsFormat(name=NestedPulsing), a_si=PostingsFormat(name=NestedPulsing)}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=false,coord=yes): {}, locale=ja, timezone=Asia/Macau
[junit4:junit4] 2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_09 (64-bit)/cpus=16,threads=39,free=85205568,total=502267904
[junit4:junit4] 2> NOTE: All tests run in this JVM: [IndexSchemaTest, TestLazyCores, TestMultiCoreConfBootstrap, TestCharFilters, SynonymTokenizerTest, TestDocumentBuilder, DocumentAnalysisRequestHandlerTest, TestDFRSimilarityFactory, AnalysisAfterCoreReloadTest, StandardRequestHandlerTest, PathHierarchyTokenizerFactoryTest, TestDistributedGrouping, TestOmitPositions, TestSolrCoreProperties, XsltUpdateRequestHandlerTest, DocumentBuilderTest, LeaderElectionTest, RecoveryZkTest, IndexReaderFactoryTest, TestSolrJ, TestBM25SimilarityFactory, SuggesterTSTTest, TestLRUCache, FieldMutatingUpdateProcessorTest, ConvertedLegacyTest, TestUtils, FullSolrCloudDistribCmdsTest, TestRecovery, OverseerTest, StatelessScriptUpdateProcessorFactoryTest, TestPhraseSuggestions, LukeRequestHandlerTest, ZkNodePropsTest, TestTrie, TestRemoteStreaming, DirectSolrSpellCheckerTest, SuggesterTest, XmlUpdateRequestHandlerTest, RequiredFieldsTest, URLClassifyProcessorTest, LegacyHTMLStripCharFilterTest, SpellingQueryConverterTest, RAMDirectoryFactoryTest, TestCSVLoader, TestWriterPerf, TestCodecSupport, HardAutoCommitTest, TestPropInject, TestDistributedSearch, OpenExchangeRatesOrgProviderTest, UUIDFieldTest, TestStressLucene, TestUpdate, TestPostingsSolrHighlighter, OutputWriterTest, TestSolrDeletionPolicy2, PolyFieldTest, BasicFunctionalityTest, ExternalFileFieldSortTest, IndexSchemaRuntimeFieldTest, BasicDistributedZkTest, ZkSolrClientTest, TestFaceting, TestHashPartitioner, DistributedTermsComponentTest, TestJoin, PeerSyncTest, TestJmxIntegration, SampleTest, TestIndexSearcher, CacheHeaderTest, QueryEqualityTest, MBeansHandlerTest, DistributedQueryElevationComponentTest, QueryParsingTest, SolrInfoMBeanTest, TestPHPSerializedResponseWriter, PingRequestHandlerTest, SuggesterWFSTTest, TestSolrQueryParser, TestReversedWildcardFilterFactory, JSONWriterTest, RequestHandlersTest, TestArbitraryIndexDir, SolrCmdDistributorTest, UpdateRequestProcessorFactoryTest, BadComponentTest, HighlighterConfigTest, DefaultValueUpdateProcessorTest, TestXIncludeConfig, TestDocSet, TestQuerySenderListener, SolrIndexConfigTest, NumericFieldsTest, TestJmxMonitoredMap, SpellPossibilityIteratorTest, TestPluginEnable, PluginInfoTest, ResourceLoaderTest, TestSystemIdResolver, ChaosMonkeySafeLeaderTest]
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ChaosMonkeySafeLeaderTest -Dtests.seed=C493A87FA26DB8AE -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ja -Dtests.timezone=Asia/Macau -Dtests.file.encoding=US-ASCII
[junit4:junit4] ERROR 0.00s J1 | ChaosMonkeySafeLeaderTest (suite) <<<
[junit4:junit4] > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([C493A87FA26DB8AE]:0)
[junit4:junit4] Completed on J1 in 7223.98s, 1 test, 2 errors <<< FAILURES!
[...truncated 11 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:381: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:361: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build.xml:183: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/common-build.xml:447: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/common-build.xml:1202: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/common-build.xml:865: There were test failures: 250 suites, 1040 tests, 1 suite-level error, 1 error, 22 ignored (4 assumptions)
Total time: 163 minutes 9 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
Re: [JENKINS] Lucene-Solr-Tests-trunk-java7 - Build # 3726 - Still Failing
Posted by Dawid Weiss <da...@cs.put.poznan.pl>.
Boom.
[junit4:junit4] >>> JVM J0: stdout (verbatim) ----
[junit4:junit4] #
[junit4:junit4] # A fatal error has been detected by the Java Runtime
Environment:
[junit4:junit4] #
[junit4:junit4] # SIGSEGV (0xb) at pc=0x000000083f9b720a, pid=52381,
tid=34577754112
[junit4:junit4] #
[junit4:junit4] # JRE version: 7.0-b05
[junit4:junit4] # Java VM: OpenJDK 64-Bit Server VM (23.5-b02 mixed
mode bsd-amd64 compressed oops)
[junit4:junit4] # Problematic frame:
[junit4:junit4] # C [libnet.so+0x920a]
Java_java_net_SocketInputStream_socketRead0+0x9a
[junit4:junit4] #
[junit4:junit4] # Core dump written. Default location:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/core
or core.52381
[junit4:junit4] #
[junit4:junit4] # An error report file with more information is saved as:
[junit4:junit4] #
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/hs_err_pid52381.log
[junit4:junit4] #
[junit4:junit4] # If you would like to submit a bug report, please visit:
[junit4:junit4] # http://bugreport.sun.com/bugreport/crash.jsp
[junit4:junit4] # The crash happened outside the Java Virtual Machine
in native code.
[junit4:junit4] # See problematic frame for where to report the bug.
[junit4:junit4] #
[junit4:junit4] <<< JVM J0: EOF ----
D.
On Mon, Feb 11, 2013 at 7:26 PM, Apache Jenkins Server
<je...@builds.apache.org> wrote:
> Build: https://builds.apache.org/job/Lucene-Solr-Tests-trunk-java7/3726/
>
> All tests passed
>
> Build Log:
> [...truncated 9421 lines...]
> [junit4:junit4] ERROR: JVM J0 ended with an exception, command line: /usr/local/openjdk7/jre/bin/java -XX:+UseG1GC -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/heapdumps -Dtests.prefix=tests -Dtests.seed=83A748D08278AA73 -Xmx512M -Dtests.iters= -Dtests.verbose=false -Dtests.infostream=false -Dtests.codec=random -Dtests.postingsformat=random -Dtests.docvaluesformat=random -Dtests.locale=random -Dtests.timezone=random -Dtests.directory=random -Dtests.linedocsfile=europarl.lines.txt.gz -Dtests.luceneMatchVersion=5.0 -Dtests.cleanthreads=perClass -Djava.util.logging.config.file=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/testlogging.properties -Dtests.nightly=false -Dtests.weekly=false -Dtests.slow=true -Dtests.asserts.gracious=false -Dtests.multiplier=3 -DtempDir=. -Djava.io.tmpdir=. -Djunit4.tempDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/temp -Dclover.db.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/clover/db -Djava.security.manager=org.apache.lucene.util.TestSecurityManager -Djava.security.policy=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/tools/junit4/tests.policy -Dlucene.version=5.0-SNAPSHOT -Djetty.testMode=1 -Djetty.insecurerandom=1 -Dsolr.directoryFactory=org.apache.solr.core.MockDirectoryFactory -Djava.awt.headless=true -Dtests.jettyConnector=Socket -Dfile.encoding=US-ASCII -classpath /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/classes/test:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-test-framework/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/test-framework/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/codecs/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-solrj/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/analysis/common/lucene-analyzers-common-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/highlighter/lucene-highlighter-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/memory/lucene-memory-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/misc/lucene-misc-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/spatial/lucene-spatial-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/suggest/lucene-suggest-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/grouping/lucene-grouping-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/queries/lucene-queries-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/queryparser/lucene-queryparser-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/cglib-nodep-2.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/commons-cli-1.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/commons-codec-1.7.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/commons-fileupload-1.2.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/commons-lang-2.6.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/easymock-3.0.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/guava-13.0.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/javax.servlet-api-3.0.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/objenesis-1.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/spatial4j-0.3.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/commons-io-2.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/httpclient-4.1.3.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/httpcore-4.1.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/httpmime-4.1.3.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/jcl-over-slf4j-1.6.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/slf4j-api-1.6.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/slf4j-jdk14-1.6.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/wstx-asl-3.2.7.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/zookeeper-3.4.5.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-continuation-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-deploy-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-http-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-io-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-jmx-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-security-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-server-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-servlet-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-util-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-webapp-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-xml-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/servlet-api-3.0.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/example-DIH/solr/db/lib/hsqldb-1.8.0.10.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/core/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/test-framework/lib/junit-4.10.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/test-framework/lib/randomizedtesting-runner-2.0.8.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-launcher.jar:/home/hudson/.ant/lib/ivy-2.2.0.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-logging.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-regexp.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-oro.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-swing.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jdepend.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-xalan2.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bsf.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit4.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-net.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-antlr.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jmf.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-netrexx.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-log4j.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-resolver.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jsch.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-testutil.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bcel.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jai.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-javamail.jar:/usr/local/openjdk7/lib/tools.jar:/home/hudson/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.0.8.jar -ea:org.apache.lucene... -ea:org.apache.solr... com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe -eventsfile /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/temp/junit4-J0-20130211_175438_581.events @/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/temp/junit4-J0-20130211_175438_581.suites
> [junit4:junit4] ERROR: JVM J0 ended with an exception: Forked process returned with error code: 134. Very likely a JVM crash. Process output piped in logs above.
> [junit4:junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4.executeSlave(JUnit4.java:1253)
> [junit4:junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4.access$000(JUnit4.java:66)
> [junit4:junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:821)
> [junit4:junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:818)
> [junit4:junit4] at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
> [junit4:junit4] at java.util.concurrent.FutureTask.run(FutureTask.java:166)
> [junit4:junit4] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
> [junit4:junit4] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
> [junit4:junit4] at java.lang.Thread.run(Thread.java:722)
>
> BUILD FAILED
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:381: The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:361: The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:39: The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build.xml:183: The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/common-build.xml:447: The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/common-build.xml:1202: The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/common-build.xml:865: At least one slave process threw an exception, first: Forked process returned with error code: 134. Very likely a JVM crash. Process output piped in logs above.
>
> Total time: 56 minutes 30 seconds
> Build step 'Invoke Ant' marked build as failure
> Archiving artifacts
> Recording test results
> Email was triggered for: Failure
> Sending email for trigger: Failure
>
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org